Sep 25 10:25:29 devstack cinder-volume[76064]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 10:25:29 devstack cinder-volume[76064]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 10:25:29 devstack cinder-volume[76064]: we strongly recommend against using it for new projects. Sep 25 10:25:29 devstack cinder-volume[76064]: If you are already using Eventlet, we recommend migrating to a different Sep 25 10:25:29 devstack cinder-volume[76064]: framework. For more detail see Sep 25 10:25:29 devstack cinder-volume[76064]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 10:25:29 devstack cinder-volume[76064]: import eventlet # noqa Sep 25 10:25:32 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:25:32 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:25:32 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:25:33 devstack cinder-volume[76064]: INFO dbcounter [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Registered counter for database cinder Sep 25 10:25:33 devstack cinder-volume[76064]: DEBUG oslo_db.sqlalchemy.engines [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:25:33 devstack cinder-volume[76064]: DEBUG dbcounter [-] [76064] Writer thread running {{(pid=76064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:25:33 devstack cinder-volume[76064]: INFO cinder.rpc [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 10:25:33 devstack cinder-volume[76064]: INFO cinder.rpc [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 10:25:33 devstack cinder-volume[76064]: DEBUG oslo_db.sqlalchemy.engines [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:25:33 devstack cinder-volume[76064]: INFO cinder.volume.manager [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Determined volume DB was empty at startup. Sep 25 10:25:33 devstack cinder-volume[76064]: DEBUG cinder.volume.manager [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76064) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 10:25:33 devstack cinder-volume[76064]: INFO cinder.volume.manager [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 10:25:33 devstack cinder-volume[76064]: WARNING stevedore.named [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 10:25:33 devstack cinder-volume[76064]: WARNING castellan.key_manager [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:25:33 devstack cinder-volume[76064]: WARNING cinder.keymgr.conf_key_mgr [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG cinder.volume.drivers.lvm [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76064) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_concurrency.processutils [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_concurrency.processutils [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] CMD "cinder-rtstool verify" returned: 0 in 0.429s {{(pid=76064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_db.sqlalchemy.engines [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:25:34 devstack cinder-volume[76064]: INFO cinder.rpc [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 10:25:34 devstack cinder-volume[76064]: INFO cinder.rpc [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 10:25:34 devstack cinder-volume[76064]: WARNING stevedore.named [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 10:25:34 devstack cinder-volume[76064]: WARNING castellan.key_manager [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:25:34 devstack cinder-volume[76064]: INFO cinder.volume.manager [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_db.sqlalchemy.engines [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:25:34 devstack cinder-volume[76064]: INFO oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Starting 1 workers Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Started child 76358 {{(pid=76064) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Full set of CONF: {{(pid=76064) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] ******************************************************************************** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Configuration options gathered from: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] ================================================================================ {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 10:25:34 devstack cinder-volume[76358]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] allow_availability_zone_fallback = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] allow_compression_on_image_upload = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] allowed_direct_url_schemes = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] api_rate_limit = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] auth_strategy = keystone {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] az_cache_duration = 3600 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_availability_zone = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_host = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_stats_polling_interval = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backup_api_class = cinder.backup.api.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backup_name_template = backup-%s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backup_use_same_host = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backup_use_temp_snapshot = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] chap_password = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] chap_username = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cinder_internal_tenant_project_id = 09463e47a554439996d185a74a3726f7 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cinder_internal_tenant_user_id = 8ede472b588f4109b5c6e764ac78c822 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cloned_volume_same_az = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cluster = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] compression_format = gzip {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] compute_api_class = cinder.compute.nova.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] config_dir = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] config_source = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] control_exchange = openstack {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] debug = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] default_availability_zone = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] default_group_type = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] default_volume_type = lvmdriver-1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] disk_geometry = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] driver_client_cert = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] driver_client_cert_key = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] driver_data_namespace = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] driver_ssl_cert_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] driver_ssl_cert_verify = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] driver_use_ssl = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] enable_force_upload = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] enable_new_services = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] enable_unsupported_driver = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] enforce_multipath_for_image_xfer = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] filter_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance_api_insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance_api_servers = ['http://192.168.122.77/image'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance_api_ssl_compression = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance_ca_certificates_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance_catalog_info = image:glance:publicURL {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance_certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance_keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance_num_retries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance_request_timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] goodness_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] graceful_shutdown_timeout = 5 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] group_api_class = cinder.group.api.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] host = devstack {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_compress_on_upload = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_conversion_address_space_limit = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_conversion_cpu_limit = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_conversion_disable = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_introspection_address_space_limit = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_introspection_cpu_limit = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_upload_use_cinder_backend = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_upload_use_internal_tenant = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_volume_cache_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_volume_cache_max_count = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] image_volume_cache_max_size_gb = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] init_host_max_objects_retrieval = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] instance_format = [instance: %(uuid)s] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] iscsi_target_flags = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] iscsi_write_cache = on {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] iser_helper = tgtadm {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] iser_ip_address = 192.168.122.77 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] iser_port = 3260 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] log_color = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] log_config_append = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] log_dir = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] log_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] log_options = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] log_rotate_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] log_rotate_interval_type = days {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] log_rotation_type = none {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] max_age = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] max_logfile_count = 30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] max_logfile_size_mb = 200 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] max_over_subscription_ratio = 20.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] message_reap_interval = 86400 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] message_ttl = 2592000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] migration_create_volume_timeout_secs = 300 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] monkey_patch = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] monkey_patch_modules = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] my_ip = 192.168.122.77 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] no_snapshot_gb_quota = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] num_iser_scan_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] num_shell_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] num_volume_device_scan_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] nvmeof_conn_info_version = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] nvmet_ns_id = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] nvmet_port_id = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76358]: INFO cinder.volume.manager [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] osapi_max_limit = 1000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] osapi_volume_ext_list = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] osapi_volume_listen_port = 8776 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] osapi_volume_use_ssl = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] osapi_volume_workers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] per_volume_size_limit = -1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] periodic_fuzzy_delay = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] periodic_interval = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] public_endpoint = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] publish_errors = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] quota_backup_gigabytes = 1000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] quota_backups = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] quota_gigabytes = 1000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] quota_groups = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] quota_snapshots = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] quota_volumes = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] rate_limit_burst = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] rate_limit_except_level = CRITICAL {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] rate_limit_interval = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] reinit_driver_count = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] replication_device = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] report_discard_supported = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] report_interval = 120 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] reservation_clean_interval = 86400 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] reservation_expire = 86400 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] reserved_image_namespaces = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] reserved_percentage = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] rpc_response_timeout = 120 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] run_external_periodic_tasks = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] scst_target_driver = iscsi {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] scst_target_iqn_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_down_time = 720 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] shell_completion = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] snapshot_name_template = snapshot-%s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] snapshot_same_host = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] split_loggers = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] state_path = /opt/stack/data/cinder {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] storage_availability_zone = nova {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] storage_protocol = iSCSI {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] syslog_log_facility = LOG_USER {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] target_helper = lioadm {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] target_ip_address = 192.168.122.77 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] target_port = 3260 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] target_protocol = iscsi {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] target_secondary_ip_addresses = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] trace_flags = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] transport_url = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] until_refresh = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] use_chap_auth = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] use_default_quota_class = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] use_journal = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] use_json = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] use_multipath_for_image_xfer = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] use_stderr = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] use_syslog = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] verify_glance_signatures = enabled {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_api_class = cinder.volume.api.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_backend_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_clear = zero {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_clear_ionice = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_clear_size = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_copy_bps_limit = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_dd_blocksize = 1M {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_name_template = volume-%s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_service_inithost_offload = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volume_usage_audit_period = month {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] zoning_mode = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_concurrency.disable_process_locking = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.auth_section = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.auth_type = password {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.auth_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.cache = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.include_service_catalog = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.interface = public {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_password = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcache_username = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.region_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.service_type = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.77/identity {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.backend = dogpile.cache.null {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.backend_argument = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.backend_expiration_time = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.config_prefix = cache.oslo {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.debug_cache_backend = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.enable_retry_client = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.enable_socket_keepalive = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.expiration_time = 600 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.hashclient_retry_attempts = 2 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.memcache_dead_retry = 300 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.memcache_pool_maxsize = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.memcache_sasl_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.password = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.proxies = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.redis_db = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.redis_server = localhost:6379 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.retry_attempts = 2 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.retry_delay = 0.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.socket_keepalive_count = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.socket_keepalive_idle = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.socket_keepalive_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.socket_timeout = 1.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.tls_allowed_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.tls_cafile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.tls_certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.tls_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.tls_keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cache.username = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] coordination.backend_url = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.asyncio_connection = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.asyncio_slave_connection = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.backend = sqlalchemy {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.connection = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.connection_debug = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.connection_parameters = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.connection_recycle_time = 3600 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.connection_trace = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.db_inc_retry_interval = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.db_max_retries = 20 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.db_max_retry_interval = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.db_retry_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.max_overflow = 50 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.max_pool_size = 5 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.max_retries = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.mysql_wsrep_sync_wait = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.pool_timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.retry_interval = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.slave_connection = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.sqlite_synchronous = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.synchronous_reader = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] database.use_db_reconnect = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_tracing.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.connection_string = messaging:// {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.es_doc_type = notification {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.es_scroll_size = 10000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.es_scroll_time = 2m {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.filter_error_trace = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.hmac_keys = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.sentinel_service_name = mymaster {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.socket_timeout = 0.1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.trace_requests = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler.trace_sqlalchemy = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler_jaeger.process_tags = {} {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler_jaeger.service_name_prefix = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] profiler_otlp.service_name_prefix = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_policy.enforce_new_defaults = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_policy.policy_default_rule = default {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_policy.policy_file = policy.yaml {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack sudo[76384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 10:25:34 devstack sudo[76384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] privsep_osbrick.group = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] privsep_osbrick.helper_command = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] privsep_osbrick.user = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cinder_sys_admin.group = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cinder_sys_admin.helper_command = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] cinder_sys_admin.user = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.auth_section = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.auth_type = password {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.cafile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.collect_timing = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.send_service_user_token = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.split_loggers = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.tls_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] service_user.tls_min_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.auth_section = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.auth_type = password {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.collect_timing = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.region_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.split_loggers = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.tls_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] glance.tls_min_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.backend_availability_zone = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.chap_password = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.chap_username = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.disk_geometry = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.driver_client_cert = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.driver_client_cert_key = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.driver_data_namespace = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.driver_use_ssl = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.extra_capabilities = {} {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.filter_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.goodness_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.iscsi_target_flags = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.iscsi_write_cache = on {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.iser_helper = tgtadm {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.iser_ip_address = 192.168.122.77 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.iser_port = 3260 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.lvm_share_target = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.lvm_type = auto {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.num_shell_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.replication_device = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.report_discard_supported = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.reserved_percentage = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.target_helper = tgtadm {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.target_ip_address = 192.168.122.77 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.target_port = 3260 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.target_protocol = iscsi {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.trace_flags = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.unique_fqdn_network = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.use_chap_auth = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.volume_backend_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.volume_clear = zero {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.volume_clear_ionice = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.volume_clear_size = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_reports.file_event_handler = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_reports.log_dir = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.backend_host = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.chap_password = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.chap_username = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.disk_geometry = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.driver_client_cert = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.extra_capabilities = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.filter_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.goodness_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.iser_helper = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.iser_ip_address = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.iser_port = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.lvm_share_target = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.lvm_type = auto {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.num_shell_tries = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.replication_device = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.report_discard_supported = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.reserved_percentage = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.scst_target_driver = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.storage_protocol = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.target_helper = lioadm {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.target_ip_address = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.target_port = 3260 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.trace_flags = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.use_chap_auth = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.volume_clear = zero {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.volume_clear_size = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] lvmdriver-1.volumes_dir = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.ssl = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_notifications.driver = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_notifications.retry = -1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] key_manager.fixed_key = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.barbican_api_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.barbican_endpoint = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.barbican_endpoint_type = public {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.barbican_region_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.cafile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.collect_timing = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.number_of_retries = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.retry_delay = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.send_service_user_token = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.split_loggers = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.tls_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.tls_min_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.verify_ssl = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican.verify_ssl_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.auth_section = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.auth_type = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.cafile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.collect_timing = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.split_loggers = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.tls_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] barbican_service_user.tls_min_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.approle_role_id = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.approle_secret_id = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.auth_method = approle {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.auth_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.kv_mountpoint = secret {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.kv_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.kv_version = 2 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.namespace = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.root_token_id = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.ssl_ca_crt_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.timeout = 60.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.token_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.token_role = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.use_ssl = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:25:34 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] ******************************************************************************** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 10:25:35 devstack sudo[76384]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:35 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:35 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:35 devstack sudo[76474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:25:35 devstack sudo[76474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:35 devstack sudo[76474]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:35 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.299s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:35 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:25:35 devstack cinder-volume[76358]: INFO cinder.brick.local_dev.lvm [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 10:25:35 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:35 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:35 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:35 devstack sudo[76617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:25:35 devstack sudo[76617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:35 devstack sudo[76617]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:35 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:35 devstack cinder-volume[76358]: DEBUG cinder.brick.local_dev.lvm [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76358) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 10:25:35 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:35 devstack sudo[76712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:25:35 devstack sudo[76712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:37 devstack sudo[76712]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:37 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.345s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:37 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:37 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:37 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:37 devstack sudo[76943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:25:37 devstack sudo[76943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:37 devstack sudo[76943]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:37 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.339s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:37 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:37 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:37 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:37 devstack sudo[77028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 10:25:37 devstack sudo[77028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:37 devstack sudo[77028]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:37 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.260s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:37 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:37 devstack sudo[77031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:25:37 devstack sudo[77031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:38 devstack sudo[77031]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:38 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:38 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:38 devstack sudo[77034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:25:38 devstack sudo[77034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:38 devstack sudo[77034]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:38 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:38 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:38 devstack sudo[77038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:25:38 devstack sudo[77038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:38 devstack sudo[77038]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:38 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:38 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:38 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:25:38 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:38 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:38 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:38 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:38 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:38 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:38 devstack sudo[77051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:25:38 devstack sudo[77051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:39 devstack sudo[77051]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:39 devstack cinder-volume[76358]: INFO cinder.volume.drivers.lvm [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:39 devstack sudo[77056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:25:39 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:39 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG cinder.volume.drivers.lvm [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Updating volume stats {{(pid=76358) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:39 devstack sudo[77059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:25:39 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:39 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:39 devstack sudo[77064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:25:39 devstack sudo[77064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:39 devstack sudo[77064]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:39 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:39 devstack sudo[77067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:25:39 devstack sudo[77067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:40 devstack sudo[77067]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:40 devstack sudo[77070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:25:40 devstack sudo[77070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:40 devstack sudo[77070]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:40 devstack cinder-volume[76358]: INFO cinder.volume.driver [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Driver hasn't implemented _init_vendor_properties() Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG cinder.volume.driver [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76358) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG oslo_db.sqlalchemy.engines [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76358) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG dbcounter [-] [76358] Writer thread running {{(pid=76358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG cinder.db.api [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Building query based on filter {{(pid=76358) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG cinder.image.image_utils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76358) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 10:25:40 devstack cinder-volume[76358]: INFO cinder.keymgr.migration [None req-5173bbe6-a4c3-49c9-8080-a3c0f59ba415 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG cinder.volume.drivers.lvm [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Updating volume stats {{(pid=76358) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:40 devstack sudo[77073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:25:40 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:40 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:40 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:40 devstack sudo[77076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:25:40 devstack sudo[77076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:41 devstack sudo[77076]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:41 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:41 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:41 devstack sudo[77081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:25:41 devstack sudo[77081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:41 devstack sudo[77081]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:41 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:41 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:41 devstack sudo[77085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:25:41 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:41 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:41 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:41 devstack cinder-volume[76358]: DEBUG cinder.manager [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Notifying Schedulers of capabilities ... {{(pid=76358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:25:41 devstack cinder-volume[76358]: INFO cinder.volume.manager [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Driver initialization completed successfully. Sep 25 10:25:41 devstack cinder-volume[76358]: INFO cinder.manager [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Initiating service 2 cleanup Sep 25 10:25:41 devstack cinder-volume[76358]: INFO cinder.manager [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Service 2 cleanup completed. Sep 25 10:25:41 devstack cinder-volume[76358]: DEBUG cinder.service [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Creating RPC server for service cinder-volume {{(pid=76358) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 10:25:41 devstack cinder-volume[76358]: DEBUG cinder.service [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76358) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 10:25:41 devstack cinder-volume[76358]: INFO cinder.volume.manager [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 10:25:41 devstack cinder-volume[76358]: DEBUG cinder.volume.drivers.lvm [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Updating volume stats {{(pid=76358) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:25:41 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:41 devstack sudo[77091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:25:41 devstack sudo[77091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:42 devstack sudo[77091]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:42 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:42 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:42 devstack sudo[77094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:25:42 devstack sudo[77094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:42 devstack sudo[77094]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:42 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.339s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:42 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:42 devstack sudo[77097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:25:42 devstack sudo[77097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:42 devstack sudo[77097]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:42 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:42 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:25:42 devstack sudo[77102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:25:42 devstack sudo[77102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:25:42 devstack sudo[77102]: pam_unix(sudo:session): session closed for user root Sep 25 10:25:42 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:25:43 devstack cinder-volume[76358]: INFO cinder.volume.manager [None req-43140e2a-15e6-4dc1-9056-572b8493e1da None None] Driver post RPC initialization completed successfully. Sep 25 10:25:44 devstack cinder-volume[76064]: DEBUG dbcounter [-] [76064] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:25:53 devstack cinder-volume[76358]: DEBUG dbcounter [-] [76358] Writing DB stats cinder:SELECT=4 {{(pid=76358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:25:53 devstack cinder-volume[76358]: DEBUG dbcounter [-] [76358] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:26:28 devstack cinder-volume[76358]: DEBUG oslo_service.periodic_task [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running periodic task VolumeManager._thread_info {{(pid=76358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:26:28 devstack cinder-volume[76358]: DEBUG cinder.volume.manager [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] thread count: 6 {{(pid=76358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:26:28 devstack cinder-volume[76358]: DEBUG cinder.volume.manager [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] thread info: [<_MainThread(MainThread, started 124966742737024)>, , , , , ] {{(pid=76358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:27:28 devstack cinder-volume[76358]: DEBUG oslo_service.periodic_task [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:27:28 devstack cinder-volume[76358]: DEBUG cinder.volume.drivers.lvm [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Updating volume stats {{(pid=76358) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:27:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:27:28 devstack sudo[82289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:27:28 devstack sudo[82289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:27:28 devstack sudo[82289]: pam_unix(sudo:session): session closed for user root Sep 25 10:27:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:27:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:27:28 devstack sudo[82294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:27:28 devstack sudo[82294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:27:28 devstack sudo[82294]: pam_unix(sudo:session): session closed for user root Sep 25 10:27:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:27:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:27:28 devstack sudo[82297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:27:28 devstack sudo[82297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:27:28 devstack sudo[82297]: pam_unix(sudo:session): session closed for user root Sep 25 10:27:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:27:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:27:28 devstack sudo[82300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:27:28 devstack sudo[82300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:27:29 devstack sudo[82300]: pam_unix(sudo:session): session closed for user root Sep 25 10:27:29 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:27:29 devstack cinder-volume[76358]: DEBUG cinder.manager [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Notifying Schedulers of capabilities ... {{(pid=76358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:27:29 devstack cinder-volume[76358]: DEBUG oslo_service.periodic_task [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running periodic task VolumeManager._thread_info {{(pid=76358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:27:29 devstack cinder-volume[76358]: DEBUG cinder.volume.manager [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] thread count: 6 {{(pid=76358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:27:29 devstack cinder-volume[76358]: DEBUG cinder.volume.manager [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] thread info: [<_MainThread(MainThread, started 124966742737024)>, , , , , ] {{(pid=76358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:27:53 devstack cinder-volume[76358]: DEBUG dbcounter [-] [76358] Writing DB stats cinder:SELECT=1 {{(pid=76358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:27:53 devstack cinder-volume[76358]: DEBUG dbcounter [-] [76358] Writing DB stats cinder:UPDATE=1 {{(pid=76358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:28:28 devstack cinder-volume[76358]: DEBUG oslo_service.periodic_task [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:28:28 devstack cinder-volume[76358]: DEBUG cinder.volume.drivers.lvm [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Updating volume stats {{(pid=76358) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:28:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:28:28 devstack sudo[83860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:28:28 devstack sudo[83860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:28:28 devstack sudo[83860]: pam_unix(sudo:session): session closed for user root Sep 25 10:28:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:28:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:28:28 devstack sudo[83884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:28:28 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:28:28 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root Sep 25 10:28:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:28:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:28:28 devstack sudo[83887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:28:28 devstack sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:28:28 devstack sudo[83887]: pam_unix(sudo:session): session closed for user root Sep 25 10:28:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:28:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:28:28 devstack sudo[83901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:28:28 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:28:29 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root Sep 25 10:28:29 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:28:29 devstack cinder-volume[76358]: DEBUG cinder.manager [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Notifying Schedulers of capabilities ... {{(pid=76358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:29:28 devstack cinder-volume[76358]: DEBUG oslo_service.periodic_task [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:29:28 devstack cinder-volume[76358]: DEBUG cinder.volume.drivers.lvm [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Updating volume stats {{(pid=76358) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 10:29:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:29:28 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 10:29:28 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:29:28 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Sep 25 10:29:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:29:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:29:28 devstack sudo[85338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:29:28 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:29:28 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root Sep 25 10:29:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:29:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:29:28 devstack sudo[85364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 10:29:28 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:29:28 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root Sep 25 10:29:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:29:28 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:29:28 devstack sudo[85367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 10:29:28 devstack sudo[85367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:29:29 devstack sudo[85367]: pam_unix(sudo:session): session closed for user root Sep 25 10:29:29 devstack cinder-volume[76358]: DEBUG oslo_concurrency.processutils [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:29:29 devstack cinder-volume[76358]: DEBUG cinder.manager [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Notifying Schedulers of capabilities ... {{(pid=76358) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:29:29 devstack cinder-volume[76358]: DEBUG oslo_service.periodic_task [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] Running periodic task VolumeManager._thread_info {{(pid=76358) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:29:29 devstack cinder-volume[76358]: DEBUG cinder.volume.manager [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] thread count: 6 {{(pid=76358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:29:29 devstack cinder-volume[76358]: DEBUG cinder.volume.manager [None req-7cc720a6-40a4-4ed9-a8f1-37a2fc272fd9 None None] thread info: [<_MainThread(MainThread, started 124966742737024)>, , , , , ] {{(pid=76358) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:29:53 devstack cinder-volume[76358]: DEBUG dbcounter [-] [76358] Writing DB stats cinder:SELECT=1 {{(pid=76358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:29:53 devstack cinder-volume[76358]: DEBUG dbcounter [-] [76358] Writing DB stats cinder:UPDATE=1 {{(pid=76358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:30:09 devstack cinder-volume[76064]: INFO oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Caught SIGTERM, stopping children Sep 25 10:30:09 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Acquiring lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:30:09 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Acquired lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:30:09 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Releasing lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:30:09 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Stop services. {{(pid=76064) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 10:30:09 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Killing children. {{(pid=76064) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 10:30:09 devstack cinder-volume[76064]: INFO oslo_service.backend._eventlet.service [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Waiting on 1 children to exit Sep 25 10:30:14 devstack cinder-volume[76358]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 25 10:30:15 devstack cinder-volume[86240]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 10:30:15 devstack cinder-volume[86240]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 10:30:15 devstack cinder-volume[86240]: we strongly recommend against using it for new projects. Sep 25 10:30:15 devstack cinder-volume[86240]: If you are already using Eventlet, we recommend migrating to a different Sep 25 10:30:15 devstack cinder-volume[86240]: framework. For more detail see Sep 25 10:30:15 devstack cinder-volume[86240]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 10:30:15 devstack cinder-volume[86240]: import eventlet # noqa Sep 25 10:30:16 devstack cinder-volume[76358]: DEBUG oslo_concurrency.lockutils [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Acquiring lock "singleton_lock" {{(pid=76358) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:30:16 devstack cinder-volume[76358]: DEBUG oslo_concurrency.lockutils [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Acquired lock "singleton_lock" {{(pid=76358) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:30:16 devstack cinder-volume[76358]: DEBUG oslo_concurrency.lockutils [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Releasing lock "singleton_lock" {{(pid=76358) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:30:16 devstack cinder-volume[76358]: WARNING amqp [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 10:30:16 devstack cinder-volume[76358]: WARNING amqp [None req-039e505b-fb7a-4edd-aa91-0488d09c1029 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 10:30:17 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:30:17 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:30:17 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:30:18 devstack cinder-volume[86240]: INFO dbcounter [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Registered counter for database cinder Sep 25 10:30:18 devstack cinder-volume[86240]: DEBUG oslo_db.sqlalchemy.engines [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:30:18 devstack cinder-volume[86240]: DEBUG dbcounter [-] [86240] Writer thread running {{(pid=86240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:30:18 devstack cinder-volume[86240]: INFO cinder.rpc [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 10:30:18 devstack cinder-volume[86240]: INFO cinder.rpc [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 10:30:18 devstack cinder-volume[86240]: DEBUG oslo_db.sqlalchemy.engines [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:30:18 devstack cinder-volume[86240]: INFO cinder.volume.manager [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Determined volume DB was empty at startup. Sep 25 10:30:18 devstack cinder-volume[86240]: DEBUG cinder.volume.manager [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86240) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 10:30:18 devstack cinder-volume[86240]: INFO cinder.volume.manager [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 10:30:18 devstack cinder-volume[86240]: WARNING stevedore.named [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 10:30:18 devstack cinder-volume[86240]: WARNING castellan.key_manager [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:30:18 devstack cinder-volume[86240]: WARNING cinder.keymgr.conf_key_mgr [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:30:18 devstack cinder-volume[86240]: INFO cinder.volume.manager [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 10:30:18 devstack cinder-volume[86240]: DEBUG oslo_db.sqlalchemy.engines [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:30:19 devstack cinder-volume[86240]: INFO oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Starting 1 workers Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Started child 86462 {{(pid=86240) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Full set of CONF: {{(pid=86240) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] ******************************************************************************** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Configuration options gathered from: {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] ================================================================================ {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] allow_availability_zone_fallback = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] allow_compression_on_image_upload = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] allowed_direct_url_schemes = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] api_rate_limit = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] auth_strategy = keystone {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_availability_zone = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_host = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_stats_polling_interval = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backup_api_class = cinder.backup.api.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86462]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backup_name_template = backup-%s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backup_use_same_host = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backup_use_temp_snapshot = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] chap_password = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] chap_username = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cinder_internal_tenant_project_id = 09463e47a554439996d185a74a3726f7 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cinder_internal_tenant_user_id = 8ede472b588f4109b5c6e764ac78c822 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cluster = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] compression_format = gzip {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] compute_api_class = cinder.compute.nova.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] config_dir = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] config_source = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] control_exchange = openstack {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] debug = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] default_availability_zone = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] default_group_type = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] default_volume_type = QuobyteHD {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] disk_geometry = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] driver_client_cert = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] driver_client_cert_key = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] driver_data_namespace = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] driver_ssl_cert_path = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] driver_ssl_cert_verify = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] driver_use_ssl = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] enable_new_services = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] enable_unsupported_driver = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] enabled_backends = ['QuobyteHD'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] enforce_multipath_for_image_xfer = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] filter_function = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance_api_insecure = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance_api_servers = ['http://192.168.122.77/image'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance_api_ssl_compression = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance_ca_certificates_file = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance_catalog_info = image:glance:publicURL {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance_certfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance_keyfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance_num_retries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance_request_timeout = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] goodness_function = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] graceful_shutdown_timeout = 5 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] group_api_class = cinder.group.api.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] host = devstack {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_compress_on_upload = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_conversion_address_space_limit = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_conversion_cpu_limit = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.remotefs [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86462) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_conversion_disable = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_introspection_address_space_limit = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_introspection_cpu_limit = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_upload_use_cinder_backend = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_upload_use_internal_tenant = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_volume_cache_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_volume_cache_max_count = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] image_volume_cache_max_size_gb = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] init_host_max_objects_retrieval = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] instance_format = [instance: %(uuid)s] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] iscsi_target_flags = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] iscsi_write_cache = on {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] iser_helper = tgtadm {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] iser_ip_address = 192.168.122.77 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] iser_port = 3260 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] log_color = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] log_config_append = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] log_dir = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] log_file = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] log_options = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] log_rotate_interval = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] log_rotate_interval_type = days {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] log_rotation_type = none {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] max_age = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] max_logfile_count = 30 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] max_logfile_size_mb = 200 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] max_over_subscription_ratio = 20.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] message_reap_interval = 86400 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] message_ttl = 2592000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] migration_create_volume_timeout_secs = 300 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] monkey_patch = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] monkey_patch_modules = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] my_ip = 192.168.122.77 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] no_snapshot_gb_quota = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] num_iser_scan_tries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] num_shell_tries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] num_volume_device_scan_tries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] nvmeof_conn_info_version = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] nvmet_ns_id = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] nvmet_port_id = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] osapi_max_limit = 1000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] osapi_volume_ext_list = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] osapi_volume_listen_port = 8776 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] osapi_volume_use_ssl = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] osapi_volume_workers = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] per_volume_size_limit = -1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] periodic_fuzzy_delay = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] periodic_interval = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] public_endpoint = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] publish_errors = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] quota_backup_gigabytes = 1000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] quota_backups = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] quota_gigabytes = 1000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] quota_groups = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] quota_snapshots = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] quota_volumes = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] rate_limit_burst = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] rate_limit_except_level = CRITICAL {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] rate_limit_interval = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] reinit_driver_count = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] replication_device = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] report_discard_supported = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] report_interval = 120 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] reservation_clean_interval = 86400 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] reservation_expire = 86400 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] reserved_image_namespaces = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] reserved_percentage = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] rpc_response_timeout = 120 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] run_external_periodic_tasks = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] scst_target_driver = iscsi {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] scst_target_iqn_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_down_time = 720 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] shell_completion = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] snapshot_name_template = snapshot-%s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] split_loggers = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] state_path = /opt/stack/data/cinder {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] storage_availability_zone = nova {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] storage_protocol = iSCSI {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] syslog_log_facility = LOG_USER {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] target_helper = lioadm {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] target_ip_address = 192.168.122.77 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] target_port = 3260 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] target_protocol = iscsi {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] target_secondary_ip_addresses = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] trace_flags = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] transport_url = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] until_refresh = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] use_chap_auth = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] use_default_quota_class = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] use_journal = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] use_json = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] use_multipath_for_image_xfer = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] use_stderr = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] use_syslog = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] verify_glance_signatures = enabled {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_api_class = cinder.volume.api.API {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_backend_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_clear = zero {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_clear_ionice = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_clear_size = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_copy_bps_limit = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_dd_blocksize = 1M {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_name_template = volume-%s {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_service_inithost_offload = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volume_usage_audit_period = month {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] zoning_mode = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_concurrency.disable_process_locking = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.auth_section = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.auth_type = password {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.auth_version = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.cache = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.certfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.include_service_catalog = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.insecure = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.interface = public {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.keyfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_password = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcache_username = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.region_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.service_type = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.77/identity {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.backend = dogpile.cache.null {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.backend_argument = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.backend_expiration_time = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.config_prefix = cache.oslo {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.debug_cache_backend = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.enable_retry_client = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.enable_socket_keepalive = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.expiration_time = 600 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.hashclient_retry_attempts = 2 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.memcache_dead_retry = 300 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.memcache_pool_maxsize = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86462) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 10:30:19 devstack cinder-volume[86462]: WARNING cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 10:30:19 devstack cinder-volume[86462]: WARNING cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Running cmd (subprocess): mount.quobyte {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.memcache_sasl_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.password = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.proxies = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.redis_db = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.redis_server = localhost:6379 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.retry_attempts = 2 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.retry_delay = 0.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.socket_keepalive_count = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.socket_keepalive_idle = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.socket_keepalive_interval = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.socket_timeout = 1.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.tls_allowed_ciphers = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.tls_cafile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.tls_certfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.tls_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.tls_keyfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cache.username = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] coordination.backend_url = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.asyncio_connection = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.asyncio_slave_connection = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.backend = sqlalchemy {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.connection = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.connection_debug = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.connection_parameters = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.connection_recycle_time = 3600 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.connection_trace = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.db_inc_retry_interval = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.db_max_retries = 20 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.db_max_retry_interval = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.db_retry_interval = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.max_overflow = 50 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.max_pool_size = 5 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.max_retries = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.mysql_wsrep_sync_wait = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.pool_timeout = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.retry_interval = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.slave_connection = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.sqlite_synchronous = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.synchronous_reader = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] database.use_db_reconnect = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_tracing.insecure = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.connection_string = messaging:// {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.es_doc_type = notification {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.es_scroll_size = 10000 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.es_scroll_time = 2m {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.filter_error_trace = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.hmac_keys = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.sentinel_service_name = mymaster {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.socket_timeout = 0.1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.trace_requests = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler.trace_sqlalchemy = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler_jaeger.process_tags = {} {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler_jaeger.service_name_prefix = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] profiler_otlp.service_name_prefix = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_policy.enforce_new_defaults = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_policy.policy_default_rule = default {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_policy.policy_file = policy.yaml {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] privsep_osbrick.group = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] privsep_osbrick.helper_command = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] privsep_osbrick.user = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cinder_sys_admin.group = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cinder_sys_admin.helper_command = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] cinder_sys_admin.user = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.auth_section = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.auth_type = password {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.cafile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.certfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.collect_timing = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.insecure = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.keyfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.send_service_user_token = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.split_loggers = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.timeout = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.tls_ciphers = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] service_user.tls_min_version = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.auth_section = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.auth_type = password {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.certfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.collect_timing = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.insecure = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.keyfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.region_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.split_loggers = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.timeout = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.tls_ciphers = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] glance.tls_min_version = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.backend_availability_zone = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.chap_password = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.chap_username = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.disk_geometry = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.driver_client_cert = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.driver_client_cert_key = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.driver_data_namespace = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.driver_use_ssl = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.extra_capabilities = {} {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.filter_function = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.goodness_function = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.iscsi_target_flags = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.iscsi_write_cache = on {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.iser_helper = tgtadm {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.iser_ip_address = 192.168.122.77 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.iser_port = 3260 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nas_host = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nas_login = admin {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nas_mount_options = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nas_password = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nas_private_key = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nas_share_path = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.num_shell_tries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.quobyte_volume_url = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.replication_device = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.report_discard_supported = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.reserved_percentage = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.target_helper = tgtadm {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.target_ip_address = 192.168.122.77 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.target_port = 3260 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.target_protocol = iscsi {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.trace_flags = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.unique_fqdn_network = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.use_chap_auth = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.volume_backend_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.volume_clear = zero {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.volume_clear_ionice = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.volume_clear_size = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_reports.file_event_handler = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_reports.log_dir = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.backend_availability_zone = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.backend_host = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.chap_password = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.chap_username = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.chiscsi_conf = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.disk_geometry = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.driver_client_cert = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.driver_data_namespace = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.driver_use_ssl = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.extra_capabilities = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.filter_function = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.goodness_function = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.iser_helper = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.iser_ip_address = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.iser_port = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.iser_target_prefix = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nas_host = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nas_login = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nas_mount_options = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nas_password = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nas_private_key = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nas_share_path = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nas_ssh_port = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.num_shell_tries = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.nvmet_port_id = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.replication_device = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.report_discard_supported = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.reserved_percentage = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.scst_target_driver = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.storage_protocol = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.target_helper = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.target_ip_address = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.target_port = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.target_prefix = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.target_protocol = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.trace_flags = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.use_chap_auth = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.volume_clear = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.volume_clear_size = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] QuobyteHD.volumes_dir = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] CMD "mount.quobyte" returned: 1 in 0.148s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=86462) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86462]: INFO cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 ... Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 -c /etc/quobyte/client-cinder.cfg {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.ssl = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_notifications.driver = [] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_notifications.retry = -1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] key_manager.fixed_key = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.barbican_api_version = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.barbican_endpoint = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.barbican_endpoint_type = public {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.barbican_region_name = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.cafile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.certfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.collect_timing = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.insecure = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.keyfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.number_of_retries = 60 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.retry_delay = 1 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.send_service_user_token = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.split_loggers = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.timeout = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.tls_ciphers = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.tls_min_version = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.verify_ssl = True {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican.verify_ssl_path = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.auth_section = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.auth_type = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.cafile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.certfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.collect_timing = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.insecure = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.keyfile = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.split_loggers = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.timeout = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.tls_ciphers = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] barbican_service_user.tls_min_version = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.approle_role_id = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.approle_secret_id = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.auth_method = approle {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.auth_path = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.kv_mountpoint = secret {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.kv_path = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.kv_version = 2 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.namespace = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.root_token_id = **** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.ssl_ca_crt_file = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.timeout = 60.0 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.token_file = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.token_role = None {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.use_ssl = False {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:19 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] ******************************************************************************** {{(pid=86240) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 10:30:19 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 -c /etc/quobyte/client-cinder.cfg Sep 25 10:30:19 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:30:19 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.518s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:30:19 devstack cinder-volume[86462]: INFO cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 succeeded Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=86462) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.534s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:30:19 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:30:19 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:30:19 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:30:20 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.269s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:30:20 devstack cinder-volume[86462]: INFO cinder.volume.driver [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG cinder.volume.driver [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4611167907715, 'free_capacity_gb': 1775.4611167907715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86462) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_db.sqlalchemy.engines [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG dbcounter [-] [86462] Writer thread running {{(pid=86462) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG cinder.db.api [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Building query based on filter {{(pid=86462) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG cinder.image.image_utils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86462) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 10:30:20 devstack cinder-volume[86462]: INFO cinder.keymgr.migration [None req-b307a77a-c0e6-4e98-9574-caff22067a3c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=86462) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=86462) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:30:20 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:30:20 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:30:20 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.264s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG cinder.manager [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Notifying Schedulers of capabilities ... {{(pid=86462) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:30:20 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Driver initialization completed successfully. Sep 25 10:30:20 devstack cinder-volume[86462]: INFO cinder.manager [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Initiating service 3 cleanup Sep 25 10:30:20 devstack cinder-volume[86462]: INFO cinder.manager [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Service 3 cleanup completed. Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG cinder.service [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Creating RPC server for service cinder-volume {{(pid=86462) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG cinder.service [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86462) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 10:30:20 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=86462) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG cinder.volume.drivers.quobyte [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=86462) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86462) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:30:20 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:30:20 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:30:20 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:30:21 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Sep 25 10:30:21 devstack cinder-volume[86462]: DEBUG oslo_concurrency.processutils [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.280s {{(pid=86462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:30:21 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-07011341-0f69-4d7f-b638-c7279ffc40f9 None None] Driver post RPC initialization completed successfully. Sep 25 10:30:25 devstack cinder-volume[86240]: INFO oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Caught SIGTERM, stopping children Sep 25 10:30:25 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Acquiring lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:30:25 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Acquired lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:30:25 devstack cinder-volume[86240]: DEBUG oslo_concurrency.lockutils [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Releasing lock "singleton_lock" {{(pid=86240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:30:25 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Stop services. {{(pid=86240) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 10:30:25 devstack cinder-volume[86240]: DEBUG oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Killing children. {{(pid=86240) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 10:30:25 devstack cinder-volume[86240]: INFO oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Waiting on 1 children to exit Sep 25 10:30:29 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Acquiring lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:30:29 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Acquired lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:30:29 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Releasing lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:30:29 devstack cinder-volume[86462]: WARNING amqp [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 10:30:29 devstack cinder-volume[86462]: WARNING amqp [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 10:30:29 devstack cinder-volume[86240]: INFO oslo_service.backend._eventlet.service [None req-7198b857-be86-4826-ab74-a1bf964db085 None None] Child 86462 exited with status 0 Sep 25 10:30:29 devstack cinder-volume[86932]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 10:30:29 devstack cinder-volume[86932]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 10:30:29 devstack cinder-volume[86932]: we strongly recommend against using it for new projects. Sep 25 10:30:29 devstack cinder-volume[86932]: If you are already using Eventlet, we recommend migrating to a different Sep 25 10:30:29 devstack cinder-volume[86932]: framework. For more detail see Sep 25 10:30:29 devstack cinder-volume[86932]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 10:30:29 devstack cinder-volume[86932]: import eventlet # noqa Sep 25 10:30:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 10:30:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 10:30:32 devstack cinder-volume[86932]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 10:30:33 devstack cinder-volume[86932]: INFO dbcounter [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Registered counter for database cinder Sep 25 10:30:33 devstack cinder-volume[86932]: DEBUG oslo_db.sqlalchemy.engines [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:30:33 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writer thread running {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:30:33 devstack cinder-volume[86932]: INFO cinder.rpc [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 10:30:33 devstack cinder-volume[86932]: INFO cinder.rpc [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 10:30:33 devstack cinder-volume[86932]: DEBUG oslo_db.sqlalchemy.engines [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:30:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Determined volume DB was empty at startup. Sep 25 10:30:33 devstack cinder-volume[86932]: DEBUG cinder.volume.manager [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86932) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 10:30:33 devstack cinder-volume[86932]: WARNING stevedore.named [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 10:30:33 devstack cinder-volume[86932]: WARNING castellan.key_manager [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:30:33 devstack cinder-volume[86932]: WARNING cinder.keymgr.conf_key_mgr [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 10:30:33 devstack cinder-volume[86932]: INFO cinder.volume.manager [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 10:30:33 devstack cinder-volume[86932]: DEBUG oslo_db.sqlalchemy.engines [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:30:34 devstack cinder-volume[86932]: INFO oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Starting 1 workers Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Started child 87242 {{(pid=86932) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Full set of CONF: {{(pid=86932) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] ******************************************************************************** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] Configuration options gathered from: {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] ================================================================================ {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] allow_availability_zone_fallback = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] allow_compression_on_image_upload = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] allowed_direct_url_schemes = [] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] api_rate_limit = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] auth_strategy = keystone {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_availability_zone = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_host = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_name = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_stats_polling_interval = 60 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backup_api_class = cinder.backup.api.API {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backup_name_template = backup-%s {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backup_use_same_host = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backup_use_temp_snapshot = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] chap_password = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] chap_username = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cinder_internal_tenant_project_id = 09463e47a554439996d185a74a3726f7 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cinder_internal_tenant_user_id = 8ede472b588f4109b5c6e764ac78c822 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cluster = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] compression_format = gzip {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] compute_api_class = cinder.compute.nova.API {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] config_dir = [] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] config_source = [] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] control_exchange = openstack {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] debug = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] default_availability_zone = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] default_group_type = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[87242]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] default_volume_type = QuobyteHD {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] disk_geometry = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] driver_client_cert = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] driver_client_cert_key = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] driver_data_namespace = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] driver_ssl_cert_path = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] driver_ssl_cert_verify = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] driver_use_ssl = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] enable_new_services = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] enable_unsupported_driver = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] enabled_backends = ['QuobyteHD'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] enforce_multipath_for_image_xfer = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] filter_function = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance_api_insecure = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance_api_servers = ['http://192.168.122.77/image'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance_api_ssl_compression = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance_ca_certificates_file = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance_catalog_info = image:glance:publicURL {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance_certfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance_keyfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance_num_retries = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance_request_timeout = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] goodness_function = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] graceful_shutdown_timeout = 5 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] group_api_class = cinder.group.api.API {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] host = devstack {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_compress_on_upload = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_conversion_address_space_limit = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_conversion_cpu_limit = 60 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_conversion_disable = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_introspection_address_space_limit = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_introspection_cpu_limit = 60 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_upload_use_cinder_backend = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_upload_use_internal_tenant = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_volume_cache_enabled = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_volume_cache_max_count = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] image_volume_cache_max_size_gb = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] init_host_max_objects_retrieval = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] instance_format = [instance: %(uuid)s] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] iscsi_target_flags = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] iscsi_write_cache = on {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] iser_helper = tgtadm {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] iser_ip_address = 192.168.122.77 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] iser_port = 3260 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] log_color = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] log_config_append = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] log_dir = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] log_file = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] log_options = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] log_rotate_interval = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] log_rotate_interval_type = days {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] log_rotation_type = none {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] max_age = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] max_logfile_count = 30 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] max_logfile_size_mb = 200 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] max_over_subscription_ratio = 20.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] message_reap_interval = 86400 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] message_ttl = 2592000 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] migration_create_volume_timeout_secs = 300 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] monkey_patch = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] monkey_patch_modules = [] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] my_ip = 192.168.122.77 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] no_snapshot_gb_quota = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] num_iser_scan_tries = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] num_shell_tries = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] num_volume_device_scan_tries = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] nvmeof_conn_info_version = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] nvmet_ns_id = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] nvmet_port_id = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] osapi_max_limit = 1000 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] osapi_volume_ext_list = [] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] osapi_volume_listen_port = 8776 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] osapi_volume_use_ssl = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] osapi_volume_workers = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] per_volume_size_limit = -1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] periodic_fuzzy_delay = 60 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] periodic_interval = 60 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] public_endpoint = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] publish_errors = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] quota_backup_gigabytes = 1000 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] quota_backups = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] quota_gigabytes = 1000 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] quota_groups = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] quota_snapshots = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] quota_volumes = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] rate_limit_burst = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] rate_limit_except_level = CRITICAL {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] rate_limit_interval = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] reinit_driver_count = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] replication_device = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] report_discard_supported = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] report_interval = 120 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] reservation_clean_interval = 86400 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] reservation_expire = 86400 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] reserved_image_namespaces = [] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] reserved_percentage = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] rpc_response_timeout = 120 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] run_external_periodic_tasks = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] scst_target_driver = iscsi {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] scst_target_iqn_name = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_down_time = 720 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] shell_completion = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] snapshot_name_template = snapshot-%s {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] split_loggers = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] state_path = /opt/stack/data/cinder {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] storage_availability_zone = nova {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] storage_protocol = iSCSI {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] syslog_log_facility = LOG_USER {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] target_helper = lioadm {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] target_ip_address = 192.168.122.77 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] target_port = 3260 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] target_protocol = iscsi {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] target_secondary_ip_addresses = [] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] trace_flags = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] transport_url = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] until_refresh = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] use_chap_auth = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] use_default_quota_class = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] use_journal = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] use_json = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] use_multipath_for_image_xfer = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] use_stderr = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] use_syslog = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] verify_glance_signatures = enabled {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_api_class = cinder.volume.api.API {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_backend_name = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_clear = zero {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_clear_ionice = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_clear_size = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_copy_bps_limit = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_dd_blocksize = 1M {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_name_template = volume-%s {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_service_inithost_offload = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volume_usage_audit_period = month {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] zoning_mode = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_concurrency.disable_process_locking = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.auth_section = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.auth_type = password {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.auth_version = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.cache = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.certfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.include_service_catalog = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.insecure = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.interface = public {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.keyfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_password = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcache_username = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.region_name = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.service_type = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.77/identity {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.backend = dogpile.cache.null {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87242) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.backend_argument = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.backend_expiration_time = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.config_prefix = cache.oslo {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.debug_cache_backend = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.enable_retry_client = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.enable_socket_keepalive = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.enabled = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.expiration_time = 600 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.hashclient_retry_attempts = 2 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.memcache_dead_retry = 300 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.memcache_pool_maxsize = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.memcache_sasl_enabled = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.password = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.proxies = [] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.redis_db = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.redis_server = localhost:6379 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.retry_attempts = 2 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.retry_delay = 0.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.socket_keepalive_count = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.socket_keepalive_idle = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.socket_keepalive_interval = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.socket_timeout = 1.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.tls_allowed_ciphers = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.tls_cafile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.tls_certfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.tls_enabled = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.tls_keyfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cache.username = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] coordination.backend_url = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.asyncio_connection = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.asyncio_slave_connection = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.backend = sqlalchemy {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.connection = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.connection_debug = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.connection_parameters = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.connection_recycle_time = 3600 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.connection_trace = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.db_inc_retry_interval = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.db_max_retries = 20 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.db_max_retry_interval = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.db_retry_interval = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.max_overflow = 50 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.max_pool_size = 5 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.max_retries = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.mysql_wsrep_sync_wait = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.pool_timeout = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.retry_interval = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.slave_connection = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.sqlite_synchronous = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.synchronous_reader = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] database.use_db_reconnect = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_tracing.insecure = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.connection_string = messaging:// {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.enabled = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.es_doc_type = notification {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.es_scroll_size = 10000 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.es_scroll_time = 2m {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.filter_error_trace = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.hmac_keys = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.sentinel_service_name = mymaster {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.socket_timeout = 0.1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.trace_requests = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler.trace_sqlalchemy = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler_jaeger.process_tags = {} {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler_jaeger.service_name_prefix = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] profiler_otlp.service_name_prefix = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_policy.enforce_new_defaults = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_policy.policy_default_rule = default {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_policy.policy_file = policy.yaml {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] privsep_osbrick.group = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] privsep_osbrick.helper_command = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] privsep_osbrick.user = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cinder_sys_admin.group = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cinder_sys_admin.helper_command = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] cinder_sys_admin.user = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.auth_section = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.auth_type = password {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.cafile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.certfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.collect_timing = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.insecure = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.keyfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.send_service_user_token = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.split_loggers = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.timeout = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.tls_ciphers = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] service_user.tls_min_version = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.auth_section = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.auth_type = password {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.certfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.collect_timing = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.insecure = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.keyfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.region_name = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.split_loggers = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.timeout = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.tls_ciphers = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] glance.tls_min_version = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.backend_availability_zone = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.chap_password = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.chap_username = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.disk_geometry = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.driver_client_cert = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.driver_client_cert_key = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.driver_data_namespace = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.driver_use_ssl = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.extra_capabilities = {} {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.filter_function = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.goodness_function = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.iscsi_target_flags = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.iscsi_write_cache = on {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.iser_helper = tgtadm {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.iser_ip_address = 192.168.122.77 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.iser_port = 3260 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nas_host = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nas_login = admin {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nas_mount_options = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nas_password = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nas_private_key = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nas_share_path = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.num_shell_tries = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.quobyte_volume_url = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.replication_device = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.report_discard_supported = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.reserved_percentage = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.target_helper = tgtadm {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.target_ip_address = 192.168.122.77 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.target_port = 3260 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.target_protocol = iscsi {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.trace_flags = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.unique_fqdn_network = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.use_chap_auth = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.volume_backend_name = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.volume_clear = zero {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.volume_clear_ionice = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.volume_clear_size = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_reports.file_event_handler = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_reports.log_dir = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.backend_availability_zone = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.backend_host = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.chap_password = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.chap_username = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.chiscsi_conf = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.disk_geometry = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.driver_client_cert = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.driver_data_namespace = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.driver_use_ssl = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.extra_capabilities = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.filter_function = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.goodness_function = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.iser_helper = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.iser_ip_address = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.iser_port = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.iser_target_prefix = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nas_host = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nas_login = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nas_mount_options = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nas_password = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nas_private_key = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nas_share_path = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nas_ssh_port = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.num_shell_tries = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.nvmet_port_id = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.replication_device = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.report_discard_supported = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.reserved_percentage = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.scst_target_driver = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.storage_protocol = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.target_helper = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.target_ip_address = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.target_port = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.target_prefix = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.target_protocol = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87242) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 10:30:34 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.quobyte [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 10:30:34 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.quobyte [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.trace_flags = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.use_chap_auth = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Running cmd (subprocess): mount.quobyte {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.volume_clear = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.volume_clear_size = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] QuobyteHD.volumes_dir = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.ssl = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_notifications.driver = [] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_notifications.retry = -1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] key_manager.fixed_key = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.barbican_api_version = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.barbican_endpoint = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.barbican_endpoint_type = public {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.barbican_region_name = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.cafile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.certfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.collect_timing = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.insecure = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.keyfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.number_of_retries = 60 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.retry_delay = 1 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.send_service_user_token = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.split_loggers = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.timeout = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.tls_ciphers = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.tls_min_version = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.verify_ssl = True {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican.verify_ssl_path = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.auth_section = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.auth_type = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.cafile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.certfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.collect_timing = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.insecure = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.keyfile = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.split_loggers = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.timeout = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.tls_ciphers = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] barbican_service_user.tls_min_version = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.approle_role_id = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.approle_secret_id = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.auth_method = approle {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.auth_path = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.kv_mountpoint = secret {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.kv_path = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.kv_version = 2 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.namespace = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.root_token_id = **** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.ssl_ca_crt_file = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.timeout = 60.0 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.token_file = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.token_role = None {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.use_ssl = False {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 10:30:34 devstack cinder-volume[86932]: DEBUG oslo_service.backend._eventlet.service [None req-28c41111-86cb-4670-ad7a-faeef4d7537d None None] ******************************************************************************** {{(pid=86932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.301s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:30:34 devstack cinder-volume[87242]: INFO cinder.volume.driver [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG cinder.volume.driver [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4611167907715, 'free_capacity_gb': 1775.4611167907715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87242) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_db.sqlalchemy.engines [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87242) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writer thread running {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG cinder.db.api [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Building query based on filter {{(pid=87242) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87242) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:30:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:30:34 devstack cinder-volume[87242]: INFO cinder.keymgr.migration [None req-b1288c5d-76a6-42c1-a741-2b253ad7544d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 10:30:34 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:30:34 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:30:35 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.272s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:30:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Driver initialization completed successfully. Sep 25 10:30:35 devstack cinder-volume[87242]: INFO cinder.manager [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Initiating service 3 cleanup Sep 25 10:30:35 devstack cinder-volume[87242]: INFO cinder.manager [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Service 3 cleanup completed. Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG cinder.service [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Creating RPC server for service cinder-volume {{(pid=87242) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG cinder.service [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87242) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 10:30:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:30:35 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:30:35 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:30:35 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Sep 25 10:30:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.246s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:30:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-69658201-1e14-4412-a1a1-0d804fac12e5 None None] Driver post RPC initialization completed successfully. Sep 25 10:30:43 devstack cinder-volume[86932]: DEBUG dbcounter [-] [86932] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:30:45 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:30:45 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=3 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:31:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:31:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 6 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:31:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:31:51 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Flow 'volume_create_manager' (2b4ace7f-cf86-482d-9182-f4d2b5add6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586db672-a7f5-41ba-b1cf-d1d7f5f8c562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586db672-a7f5-41ba-b1cf-d1d7f5f8c562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1617844895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0142601e-679d-482d-a643-8bc6c19d2e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e8762fd7d745c1b9b1b016d513cc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:31:52Z,use_quota=True,user_id='f3701e9ad4e945b6b91208a2803e0415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebfb3a4-1bdf-4190-adf9-cba735de1421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebfb3a4-1bdf-4190-adf9-cba735de1421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0824b6e-6b41-4358-abba-e71d626beef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0824b6e-6b41-4358-abba-e71d626beef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0142601e-679d-482d-a643-8bc6c19d2e29', 'volume_name': 'volume-0142601e-679d-482d-a643-8bc6c19d2e29', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0b3157-6a91-4bae-8c7c-c6624494272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0b3157-6a91-4bae-8c7c-c6624494272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42fe96fe-0ce5-4677-be02-247e329d97fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:31:52 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Volume 0142601e-679d-482d-a643-8bc6c19d2e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0142601e-679d-482d-a643-8bc6c19d2e29', 'volume_size': 1} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1617844895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0142601e-679d-482d-a643-8bc6c19d2e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e8762fd7d745c1b9b1b016d513cc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:31:52Z,use_quota=True,user_id='f3701e9ad4e945b6b91208a2803e0415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Creating volume 0142601e-679d-482d-a643-8bc6c19d2e29 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:31:52 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:31:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:31:52 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29 1073741824 Sep 25 10:31:52 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:31:54 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Sep 25 10:31:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29 1073741824" returned: 0 in 1.883s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:31:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:31:54 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29 Sep 25 10:31:54 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:31:55 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Sep 25 10:31:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29" returned: 0 in 0.830s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:31:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] <== create_volume: return (2880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:31:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.888s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:31:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42fe96fe-0ce5-4677-be02-247e329d97fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0142601e-679d-482d-a643-8bc6c19d2e29', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:31:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c18a1e-661a-4f21-92a8-2ab49549dbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:31:55 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Volume volume-0142601e-679d-482d-a643-8bc6c19d2e29 (0142601e-679d-482d-a643-8bc6c19d2e29): created successfully Sep 25 10:31:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c18a1e-661a-4f21-92a8-2ab49549dbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:31:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Flow 'volume_create_manager' (2b4ace7f-cf86-482d-9182-f4d2b5add6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:31:55 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-813eeebc-9aad-4a11-96c2-a9d684e029f5 tempest-DeleteServersTestJSON-1681639028 None] Created volume successfully. Sep 25 10:32:02 devstack cinder-volume[87242]: WARNING py.warnings [req-38252b5b-aeef-450c-b002-b5c5b8c81941 req-3af40ce1-107e-4a6e-9487-586712bd63a2 tempest-DeleteServersTestJSON-1681639028 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 25 10:32:02 devstack cinder-volume[87242]: .first() Sep 25 10:32:02 devstack cinder-volume[87242]: Sep 25 10:32:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-38252b5b-aeef-450c-b002-b5c5b8c81941 req-3af40ce1-107e-4a6e-9487-586712bd63a2 tempest-DeleteServersTestJSON-1681639028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-38252b5b-aeef-450c-b002-b5c5b8c81941 req-3af40ce1-107e-4a6e-9487-586712bd63a2 tempest-DeleteServersTestJSON-1681639028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-38252b5b-aeef-450c-b002-b5c5b8c81941 req-3af40ce1-107e-4a6e-9487-586712bd63a2 tempest-DeleteServersTestJSON-1681639028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:32:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-38252b5b-aeef-450c-b002-b5c5b8c81941 req-3af40ce1-107e-4a6e-9487-586712bd63a2 tempest-DeleteServersTestJSON-1681639028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-0142601e-679d-482d-a643-8bc6c19d2e29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74aa1e28-757c-4f19-95fd-bbd24c8252a6', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:32:02 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-38252b5b-aeef-450c-b002-b5c5b8c81941 req-3af40ce1-107e-4a6e-9487-586712bd63a2 tempest-DeleteServersTestJSON-1681639028 None] attachment_update completed successfully. Sep 25 10:32:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:32:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:32:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:32:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:32:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:03 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:32:03 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:04 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.693s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:32:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:32:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 6 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:32:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Flow 'volume_create_manager' (75ae60f6-ea17-45a6-b9c3-3efcb803ee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57968f4-7023-4d11-9ef2-c40fc6b3e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57968f4-7023-4d11-9ef2-c40fc6b3e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1080133805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a112e94-d395-4902-b52c-eb447c0a555e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190be9d77f2e47c5991da9f2ae487795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:32:07Z,use_quota=True,user_id='ee1fcec9d77c45939881ed76c4156fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebfad3d-aea8-4325-bb3f-38aa0a69815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebfad3d-aea8-4325-bb3f-38aa0a69815f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6bf9ed-f5ac-46e1-8419-60138a8e95d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6bf9ed-f5ac-46e1-8419-60138a8e95d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a112e94-d395-4902-b52c-eb447c0a555e', 'volume_name': 'volume-2a112e94-d395-4902-b52c-eb447c0a555e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a1aff1-3a65-4535-b771-2c8f4602d7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a1aff1-3a65-4535-b771-2c8f4602d7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ecdbf8-c218-4d87-96b4-e1b4ca51c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:07 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Volume 2a112e94-d395-4902-b52c-eb447c0a555e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a112e94-d395-4902-b52c-eb447c0a555e', 'volume_size': 1} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1080133805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a112e94-d395-4902-b52c-eb447c0a555e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190be9d77f2e47c5991da9f2ae487795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:32:07Z,use_quota=True,user_id='ee1fcec9d77c45939881ed76c4156fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Creating volume 2a112e94-d395-4902-b52c-eb447c0a555e {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:32:07 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:32:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:07 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e 1073741824 Sep 25 10:32:07 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:09 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e 1073741824" returned: 0 in 1.614s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:09 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e Sep 25 10:32:09 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:10 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e" returned: 0 in 1.190s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] <== create_volume: return (2981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:32:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.990s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:32:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ecdbf8-c218-4d87-96b4-e1b4ca51c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a112e94-d395-4902-b52c-eb447c0a555e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e365898-0995-4d84-8666-b75b69f137a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:10 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Volume volume-2a112e94-d395-4902-b52c-eb447c0a555e (2a112e94-d395-4902-b52c-eb447c0a555e): created successfully Sep 25 10:32:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e365898-0995-4d84-8666-b75b69f137a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Flow 'volume_create_manager' (75ae60f6-ea17-45a6-b9c3-3efcb803ee59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:32:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1d46d67c-3e32-4dc4-b9e1-126f935e3030 tempest-ServerRescueNegativeTestJSON-2060249186 None] Created volume successfully. Sep 25 10:32:12 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-b5efc60e-43d2-472f-90c0-18530014153f req-8458c1b7-65d3-4487-a4f3-0042ba822a28 tempest-DeleteServersTestJSON-1681639028 None] Terminate volume connection completed successfully. Sep 25 10:32:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-b5efc60e-43d2-472f-90c0-18530014153f req-8458c1b7-65d3-4487-a4f3-0042ba822a28 tempest-DeleteServersTestJSON-1681639028 None] Deleting attachment 74aa1e28-757c-4f19-95fd-bbd24c8252a6. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Flow 'volume_create_manager' (18d95ccd-4ef2-4af7-b278-73422478cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71211148-0ab2-4f55-bdb9-6a9960b6aabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71211148-0ab2-4f55-bdb9-6a9960b6aabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-656956716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec21368-d36a-4a1c-a5c3-71ac46668b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4baba906652847f6b8886f6cfcf73673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:32:15Z,use_quota=True,user_id='2d8ee3eb63b44aed8b7f48d28fd3467d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fdac48-0115-4a42-8138-74cf727a9680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fdac48-0115-4a42-8138-74cf727a9680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf79b1e9-a617-4513-9fea-077759b46d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf79b1e9-a617-4513-9fea-077759b46d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec21368-d36a-4a1c-a5c3-71ac46668b50', 'volume_name': 'volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fbfcd6-65f3-417e-b29b-e958cb7864b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fbfcd6-65f3-417e-b29b-e958cb7864b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba3248e-d570-430a-99f9-4df6ec7da1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:15 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Volume 3ec21368-d36a-4a1c-a5c3-71ac46668b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50', 'volume_size': 1} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-656956716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec21368-d36a-4a1c-a5c3-71ac46668b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4baba906652847f6b8886f6cfcf73673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:32:15Z,use_quota=True,user_id='2d8ee3eb63b44aed8b7f48d28fd3467d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Creating volume 3ec21368-d36a-4a1c-a5c3-71ac46668b50 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:32:15 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:32:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:15 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50 1073741824 Sep 25 10:32:15 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:16 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50 1073741824" returned: 0 in 1.168s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Acquiring lock "cinder-0142601e-679d-482d-a643-8bc6c19d2e29-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:32:16 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50 Sep 25 10:32:16 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Lock "cinder-0142601e-679d-482d-a643-8bc6c19d2e29-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:32:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Acquiring lock "cinder-quobyte-0142601e-679d-482d-a643-8bc6c19d2e29" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:32:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Lock "cinder-quobyte-0142601e-679d-482d-a643-8bc6c19d2e29" acquired by "delete_volume" :: waited 0.058s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:32:16 devstack cinder-volume[87242]: INFO oslo.privsep.daemon [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4l0snqiu/privsep.sock'] Sep 25 10:32:16 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4l0snqiu/privsep.sock Sep 25 10:32:16 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:17 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50" returned: 0 in 0.879s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:32:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:32:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba3248e-d570-430a-99f9-4df6ec7da1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1ed009-0633-449c-8216-f945ce4f69d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:17 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Volume volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50 (3ec21368-d36a-4a1c-a5c3-71ac46668b50): created successfully Sep 25 10:32:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1ed009-0633-449c-8216-f945ce4f69d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Flow 'volume_create_manager' (18d95ccd-4ef2-4af7-b278-73422478cb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:32:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e34ebccd-9960-435a-ac24-1c548f424a8b tempest-VolumesAdminNegativeTest-1523329175 None] Created volume successfully. Sep 25 10:32:18 devstack cinder-volume[87242]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 10:32:18 devstack cinder-volume[87242]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 10:32:18 devstack cinder-volume[87242]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 10:32:18 devstack cinder-volume[87242]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 10:32:18 devstack cinder-volume[87242]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 10:32:18 devstack cinder-volume[87242]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 10:32:18 devstack cinder-volume[87242]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 10:32:18 devstack cinder-volume[87242]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 10:32:18 devstack cinder-volume[87242]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 10:32:19 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:19 devstack cinder-volume[87242]: INFO oslo.privsep.daemon [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Spawned new privsep daemon via rootwrap Sep 25 10:32:19 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Accepted privsep connection to /tmp/tmp4l0snqiu/privsep.sock {{(pid=87242) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 10:32:19 devstack cinder-volume[87242]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 10:32:19 devstack cinder-volume[87242]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 10:32:19 devstack cinder-volume[87242]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 10:32:19 devstack cinder-volume[87242]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89017 Sep 25 10:32:19 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb88ee5-2ef5-4b92-87e2-2dcd5790c656]: (2,) {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:32:19 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b4b494-99aa-4460-a29d-1c0975c67d01]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:32:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:19 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29 Sep 25 10:32:19 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Acquiring lock "cinder-3ec21368-d36a-4a1c-a5c3-71ac46668b50-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:32:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Lock "cinder-3ec21368-d36a-4a1c-a5c3-71ac46668b50-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:32:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Acquiring lock "cinder-quobyte-3ec21368-d36a-4a1c-a5c3-71ac46668b50" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:32:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Lock "cinder-quobyte-3ec21368-d36a-4a1c-a5c3-71ac46668b50" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:32:20 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e6de14-1f50-4772-a13d-e61c8ef8d698]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:32:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:20 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29" returned: 0 in 0.957s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:20 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29 Sep 25 10:32:20 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:20 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50 Sep 25 10:32:20 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:20 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50" returned: 0 in 0.648s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:20 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50 Sep 25 10:32:20 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:20 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0142601e-679d-482d-a643-8bc6c19d2e29" returned: 0 in 0.549s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Lock "cinder-quobyte-0142601e-679d-482d-a643-8bc6c19d2e29" released by "delete_volume" :: held 4.012s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:32:20 devstack cinder-volume[87242]: WARNING cinder.quota [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:32:20 devstack cinder-volume[87242]: WARNING cinder.quota [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Created reservations ['8b62902a-78bc-4dc0-9460-0413c6d5f0cd', '3c7cceb1-b185-49a5-b08c-1ec3f452cda3', '4fcf4b85-3b8d-49f5-9112-508701b5b79a', '2686f310-dc5d-4ad5-8d42-a36fa3422658'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:21 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3ec21368-d36a-4a1c-a5c3-71ac46668b50" returned: 0 in 0.537s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:21 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:32:21 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Lock "cinder-quobyte-3ec21368-d36a-4a1c-a5c3-71ac46668b50" released by "delete_volume" :: held 1.358s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Created reservations ['097a9bcc-4166-49f9-9c18-66d8f3868498', 'c55cbcf5-f455-4734-b1be-b04e064d0c8b', 'e6ccab27-347b-4aec-b762-3611d2f05529', 'e5462f33-8b7c-4cec-83cb-9e3442cafb59'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:21 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:32:21 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:21 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.583s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:21 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:32:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Deleted volume successfully. Sep 25 10:32:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2d0ad4e7-2f0b-4b4c-b03b-e77c78513da5 tempest-DeleteServersTestJSON-1681639028 None] Lock "cinder-0142601e-679d-482d-a643-8bc6c19d2e29-delete_volume" released by "delete_volume" :: held 5.314s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:32:22 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.385s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:22 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:32:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Deleted volume successfully. Sep 25 10:32:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c35b33e1-d91f-451b-84e1-904544cdb0fb tempest-VolumesAdminNegativeTest-1523329175 None] Lock "cinder-3ec21368-d36a-4a1c-a5c3-71ac46668b50-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:32:31 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=27,cinder:UPDATE=31,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:32:32 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=22,cinder:SELECT=20,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:32:45 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:32:45 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:32:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Acquiring lock "cinder-2a112e94-d395-4902-b52c-eb447c0a555e-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:32:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Lock "cinder-2a112e94-d395-4902-b52c-eb447c0a555e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:32:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Acquiring lock "cinder-quobyte-2a112e94-d395-4902-b52c-eb447c0a555e" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:32:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Lock "cinder-quobyte-2a112e94-d395-4902-b52c-eb447c0a555e" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:32:45 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b4c178-e9c2-4d83-aae4-014549828fc3]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:32:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:46 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e Sep 25 10:32:46 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:46 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e" returned: 0 in 0.638s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:46 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e Sep 25 10:32:46 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:47 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a112e94-d395-4902-b52c-eb447c0a555e" returned: 0 in 0.564s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Lock "cinder-quobyte-2a112e94-d395-4902-b52c-eb447c0a555e" released by "delete_volume" :: held 1.281s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Created reservations ['a420d5d1-a220-49d2-87c8-1f5dd753d574', '8d16ec56-6d92-4ebc-8aa5-4c2b37a6194e', '7142c12b-62f4-4016-b3ff-97ce63aa7d6e', '591e1565-fa40-466b-a301-69e8ca5405bb'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:47 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:32:47 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:32:47 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.391s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:32:47 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Deleted volume successfully. Sep 25 10:32:47 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8ff1e979-231a-4915-8fe5-0bc8edba6c7a tempest-ServerRescueNegativeTestJSON-2060249186 None] Lock "cinder-2a112e94-d395-4902-b52c-eb447c0a555e-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:32:57 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:32:57 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Flow 'volume_create_manager' (e95f7654-3138-4c35-9ab2-8a893100621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ca9fe8-1eb9-4d7e-b42b-c23a7a8d30cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ca9fe8-1eb9-4d7e-b42b-c23a7a8d30cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1139070545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4135361-a115-4169-b868-afe27b807909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b4e355874b426890970aad23947db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:32:59Z,use_quota=True,user_id='e2fae856e14f4c3892b7dde5a39628a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4939a3e4-5e49-4880-84ff-619107906b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4939a3e4-5e49-4880-84ff-619107906b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df003987-474b-4f37-a5a7-d232572a8a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df003987-474b-4f37-a5a7-d232572a8a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4135361-a115-4169-b868-afe27b807909', 'volume_name': 'volume-b4135361-a115-4169-b868-afe27b807909', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e682ed9-5aa2-4ed1-9c47-ec3fa6f3e815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e682ed9-5aa2-4ed1-9c47-ec3fa6f3e815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7246e77-6a53-4443-9ed3-29feb46f0458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:32:59 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Volume b4135361-a115-4169-b868-afe27b807909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4135361-a115-4169-b868-afe27b807909', 'volume_size': 1} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1139070545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4135361-a115-4169-b868-afe27b807909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b4e355874b426890970aad23947db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:32:59Z,use_quota=True,user_id='e2fae856e14f4c3892b7dde5a39628a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Creating volume b4135361-a115-4169-b868-afe27b807909 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:32:59 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:32:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:32:59 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909 1073741824 Sep 25 10:32:59 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:33:00 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Sep 25 10:33:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909 1073741824" returned: 0 in 0.826s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:33:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:33:00 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909 Sep 25 10:33:00 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:33:00 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Sep 25 10:33:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909" returned: 0 in 0.396s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:33:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:33:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:33:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7246e77-6a53-4443-9ed3-29feb46f0458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4135361-a115-4169-b868-afe27b807909', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:33:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e13c31f-6e73-42a8-92c1-5bda678e9e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:33:00 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Volume volume-b4135361-a115-4169-b868-afe27b807909 (b4135361-a115-4169-b868-afe27b807909): created successfully Sep 25 10:33:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e13c31f-6e73-42a8-92c1-5bda678e9e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:33:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Flow 'volume_create_manager' (e95f7654-3138-4c35-9ab2-8a893100621c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:33:00 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1550f6cb-caca-4fb5-aaec-fc60c63bad7c tempest-TaggedAttachmentsTest-892545973 None] Created volume successfully. Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:33:03 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:33:03 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:33:03 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.284s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 8 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:33:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:33:10 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:33:10 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Flow 'volume_create_manager' (eabe9742-be31-4273-8ff7-1aa4242305d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26945f78-e1c2-4398-8936-7db880441da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26945f78-e1c2-4398-8936-7db880441da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-148393219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54325c52-869d-4b15-9701-c99c8c271dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83605dc8349546bd975c2e0b0c114a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:33:41Z,use_quota=True,user_id='b471b7d0c9084d77a94b2d0e20f55da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccbd4f6-1d27-4a2d-bd0a-0cf10d78816b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccbd4f6-1d27-4a2d-bd0a-0cf10d78816b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e410422a-ed70-4f99-bea9-a7a0f087642a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e410422a-ed70-4f99-bea9-a7a0f087642a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54325c52-869d-4b15-9701-c99c8c271dde', 'volume_name': 'volume-54325c52-869d-4b15-9701-c99c8c271dde', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5a9c3a-0b93-427a-ac0f-5a7d728104e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5a9c3a-0b93-427a-ac0f-5a7d728104e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd846d40-36cc-4d03-88c1-a142f1afbb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:33:41 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Volume 54325c52-869d-4b15-9701-c99c8c271dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54325c52-869d-4b15-9701-c99c8c271dde', 'volume_size': 1} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-148393219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54325c52-869d-4b15-9701-c99c8c271dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83605dc8349546bd975c2e0b0c114a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:33:41Z,use_quota=True,user_id='b471b7d0c9084d77a94b2d0e20f55da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Creating volume 54325c52-869d-4b15-9701-c99c8c271dde {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:33:41 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:33:41 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde 1073741824 Sep 25 10:33:41 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:33:41 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Sep 25 10:33:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde 1073741824" returned: 0 in 0.752s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:33:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:33:42 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde Sep 25 10:33:42 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:33:42 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Sep 25 10:33:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde" returned: 0 in 0.447s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:33:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:33:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:33:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd846d40-36cc-4d03-88c1-a142f1afbb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54325c52-869d-4b15-9701-c99c8c271dde', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:33:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b6dd1b-3513-494f-acfa-9ac31e9932c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:33:42 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Volume volume-54325c52-869d-4b15-9701-c99c8c271dde (54325c52-869d-4b15-9701-c99c8c271dde): created successfully Sep 25 10:33:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b6dd1b-3513-494f-acfa-9ac31e9932c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:33:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Flow 'volume_create_manager' (eabe9742-be31-4273-8ff7-1aa4242305d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:33:42 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d35799df-0966-4d70-b293-0ccaab592df2 tempest-AttachVolumeNegativeTest-734399829 None] Created volume successfully. Sep 25 10:33:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-b560981e-72f2-4a1a-ba26-c887379700ab req-bf0c7b1f-c768-4427-9fde-a9dd45db1a09 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:33:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-b560981e-72f2-4a1a-ba26-c887379700ab req-bf0c7b1f-c768-4427-9fde-a9dd45db1a09 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:33:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-b560981e-72f2-4a1a-ba26-c887379700ab req-bf0c7b1f-c768-4427-9fde-a9dd45db1a09 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:33:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-b560981e-72f2-4a1a-ba26-c887379700ab req-bf0c7b1f-c768-4427-9fde-a9dd45db1a09 tempest-AttachVolumeNegativeTest-734399829 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-54325c52-869d-4b15-9701-c99c8c271dde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82e9bbb5-7291-4758-85bd-6696186705b5', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:33:46 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-b560981e-72f2-4a1a-ba26-c887379700ab req-bf0c7b1f-c768-4427-9fde-a9dd45db1a09 tempest-AttachVolumeNegativeTest-734399829 None] attachment_update completed successfully. Sep 25 10:33:56 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:33:56 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=6,cinder:SELECT=9,cinder:INSERT=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:34:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:34:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:34:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:34:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:03 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:34:03 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:04 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.663s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:34:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-23098448-4153-48c1-ada0-75e9c886eff6 req-cca821b2-8967-4ade-bd7a-5d2282baada4 tempest-TaggedAttachmentsTest-892545973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-23098448-4153-48c1-ada0-75e9c886eff6 req-cca821b2-8967-4ade-bd7a-5d2282baada4 tempest-TaggedAttachmentsTest-892545973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-23098448-4153-48c1-ada0-75e9c886eff6 req-cca821b2-8967-4ade-bd7a-5d2282baada4 tempest-TaggedAttachmentsTest-892545973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-23098448-4153-48c1-ada0-75e9c886eff6 req-cca821b2-8967-4ade-bd7a-5d2282baada4 tempest-TaggedAttachmentsTest-892545973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-b4135361-a115-4169-b868-afe27b807909', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '648d685d-7f74-4bb7-8509-19de64034d9d', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:34:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-23098448-4153-48c1-ada0-75e9c886eff6 req-cca821b2-8967-4ade-bd7a-5d2282baada4 tempest-TaggedAttachmentsTest-892545973 None] attachment_update completed successfully. Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Flow 'volume_create_manager' (59034ecb-5700-4096-b70c-8664591ce620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f585b3-da9e-4bd3-9681-9d53c3887c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f585b3-da9e-4bd3-9681-9d53c3887c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1886144221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280f1f23-b1c6-4e09-ade5-73c6b44ad61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bc8cd55db74c6d9bf3b6a575ecff8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:34:15Z,use_quota=True,user_id='a852521c6924433899842a98905ff4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79244a1-0164-411d-bdbb-53c74c98d3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79244a1-0164-411d-bdbb-53c74c98d3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323687e8-f89d-4d15-b4fb-00f954c69ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323687e8-f89d-4d15-b4fb-00f954c69ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280f1f23-b1c6-4e09-ade5-73c6b44ad61b', 'volume_name': 'volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc318162-0352-46c3-bf2f-4c0d55b91cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc318162-0352-46c3-bf2f-4c0d55b91cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824ab182-daf3-4dc6-a54a-2ddfc0b2b22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:14 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Volume 280f1f23-b1c6-4e09-ade5-73c6b44ad61b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b', 'volume_size': 1} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1886144221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280f1f23-b1c6-4e09-ade5-73c6b44ad61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bc8cd55db74c6d9bf3b6a575ecff8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:34:15Z,use_quota=True,user_id='a852521c6924433899842a98905ff4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Creating volume 280f1f23-b1c6-4e09-ade5-73c6b44ad61b {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:34:14 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:34:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:14 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b 1073741824 Sep 25 10:34:14 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:15 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b 1073741824" returned: 0 in 0.587s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:15 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b Sep 25 10:34:15 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:15 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-25ac238d-ee5e-4968-9b67-17af9132c028 req-1e4eb464-93b5-485b-b259-37ffcbdaac59 tempest-TaggedAttachmentsTest-892545973 None] Terminate volume connection completed successfully. Sep 25 10:34:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-25ac238d-ee5e-4968-9b67-17af9132c028 req-1e4eb464-93b5-485b-b259-37ffcbdaac59 tempest-TaggedAttachmentsTest-892545973 None] Deleting attachment 648d685d-7f74-4bb7-8509-19de64034d9d. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:34:15 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b" returned: 0 in 0.444s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:34:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824ab182-daf3-4dc6-a54a-2ddfc0b2b22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8c2e6e-b5f7-422f-8e6b-7fec883ea4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:16 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Volume volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b (280f1f23-b1c6-4e09-ade5-73c6b44ad61b): created successfully Sep 25 10:34:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8c2e6e-b5f7-422f-8e6b-7fec883ea4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Flow 'volume_create_manager' (59034ecb-5700-4096-b70c-8664591ce620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:34:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b9d55967-0e08-47df-bde9-b66723342731 tempest-ServersNegativeTestJSON-1177866163 None] Created volume successfully. Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Flow 'volume_create_manager' (d190b892-c09c-442e-91bc-f203b8e0484b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea13c00-a2c8-4424-93d9-ebdf62aa1bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea13c00-a2c8-4424-93d9-ebdf62aa1bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1729877944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bc8cd55db74c6d9bf3b6a575ecff8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:34:19Z,use_quota=True,user_id='a852521c6924433899842a98905ff4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7e4e03-535d-42d5-be6a-9b18448fb9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7e4e03-535d-42d5-be6a-9b18448fb9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee6201a-a66a-4f4f-b5b9-ee76e53687ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee6201a-a66a-4f4f-b5b9-ee76e53687ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1', 'volume_name': 'volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd02ed6-b14d-48ff-9694-3620261c0ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd02ed6-b14d-48ff-9694-3620261c0ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600eb10e-012b-4336-8e29-cc2b82b573e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:19 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Volume f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1', 'volume_size': 1} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1729877944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bc8cd55db74c6d9bf3b6a575ecff8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:34:19Z,use_quota=True,user_id='a852521c6924433899842a98905ff4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Creating volume f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:34:19 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:34:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:19 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 1073741824 Sep 25 10:34:19 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:20 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 1073741824" returned: 0 in 0.613s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:20 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 Sep 25 10:34:20 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:20 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1" returned: 0 in 0.306s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:34:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600eb10e-012b-4336-8e29-cc2b82b573e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38774f52-326f-45cc-96fd-23f0f77ce080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:20 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Volume volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 (f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1): created successfully Sep 25 10:34:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38774f52-326f-45cc-96fd-23f0f77ce080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Flow 'volume_create_manager' (d190b892-c09c-442e-91bc-f203b8e0484b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:34:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8a78257b-0f3a-459c-bed3-9eaf59c17d38 tempest-ServersNegativeTestJSON-1177866163 None] Created volume successfully. Sep 25 10:34:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Acquiring lock "cinder-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:34:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Lock "cinder-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:34:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Acquiring lock "cinder-quobyte-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:34:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Lock "cinder-quobyte-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1" acquired by "delete_volume" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:34:22 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7c2acc-e8c2-4de4-a889-136a0699d78f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:34:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:22 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 Sep 25 10:34:22 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:22 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1" returned: 0 in 0.445s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:22 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1 Sep 25 10:34:22 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:22 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1" returned: 0 in 0.324s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Lock "cinder-quobyte-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1" released by "delete_volume" :: held 0.871s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:34:22 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Created reservations ['0b94eea2-963a-410b-9a28-bd4812641bf8', 'e2b5dc4b-95bc-4935-b3a3-8e5b2f15e71d', '739798a8-9e04-4b5e-be54-293e47b0f3a7', '8d626d68-c18e-4390-b2cc-ff6150138e5d'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:23 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:34:23 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Acquiring lock "cinder-280f1f23-b1c6-4e09-ade5-73c6b44ad61b-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Lock "cinder-280f1f23-b1c6-4e09-ade5-73c6b44ad61b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Acquiring lock "cinder-quobyte-280f1f23-b1c6-4e09-ade5-73c6b44ad61b" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Lock "cinder-quobyte-280f1f23-b1c6-4e09-ade5-73c6b44ad61b" acquired by "delete_volume" :: waited 0.015s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[27308bd3-7175-48e4-a98c-3767ddec0595]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:23 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.319s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:34:23 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b Sep 25 10:34:23 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Deleted volume successfully. Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a09f395e-11fd-4544-a7fb-fe4ae297b4d0 tempest-ServersNegativeTestJSON-1177866163 None] Lock "cinder-f0f2d779-45de-4c4a-9bbd-4ea7f610e9a1-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:34:23 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b" returned: 0 in 0.395s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:23 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b Sep 25 10:34:23 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:23 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-280f1f23-b1c6-4e09-ade5-73c6b44ad61b" returned: 0 in 0.278s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Lock "cinder-quobyte-280f1f23-b1c6-4e09-ade5-73c6b44ad61b" released by "delete_volume" :: held 0.721s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:34:24 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Created reservations ['d0c77b37-49b7-4444-bcad-c4ed6381cfb3', 'a7c5a096-cb13-4311-ae16-5a3b05c6c0f6', '228f156a-8995-4777-95ac-337e8c326226', 'c825e4bc-309f-4e64-aa31-e91e823cd087'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:34:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:34:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:34:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:24 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:34:24 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:24 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.356s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:24 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:34:24 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Deleted volume successfully. Sep 25 10:34:24 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6d1360d6-c11b-4677-a92f-d48f15a68768 tempest-ServersNegativeTestJSON-1177866163 None] Lock "cinder-280f1f23-b1c6-4e09-ade5-73c6b44ad61b-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:34:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Acquiring lock "cinder-b4135361-a115-4169-b868-afe27b807909-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:34:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Lock "cinder-b4135361-a115-4169-b868-afe27b807909-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:34:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Acquiring lock "cinder-quobyte-b4135361-a115-4169-b868-afe27b807909" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:34:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Lock "cinder-quobyte-b4135361-a115-4169-b868-afe27b807909" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:34:26 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b854f0-d80d-4311-aea5-7e7997f3ac47]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:34:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:26 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909 Sep 25 10:34:26 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:27 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909" returned: 0 in 0.395s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:27 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909 Sep 25 10:34:27 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:27 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b4135361-a115-4169-b868-afe27b807909" returned: 0 in 0.259s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Lock "cinder-quobyte-b4135361-a115-4169-b868-afe27b807909" released by "delete_volume" :: held 0.714s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Created reservations ['56c1d158-c337-4d4c-ae53-59b68f19fcf0', '7223b3f1-2084-44a1-aa82-48e387b99a52', '162af464-04c1-4655-884e-947dd50c8377', 'a1496adf-bb89-4e0e-b22a-ae8ebbf39133'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:27 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:34:27 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:27 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.281s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:34:27 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Deleted volume successfully. Sep 25 10:34:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d19995d-cf9e-480b-bca9-8489f0ac3337 tempest-TaggedAttachmentsTest-892545973 None] Lock "cinder-b4135361-a115-4169-b868-afe27b807909-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:34:32 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:34:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Flow 'volume_create_manager' (41984cfa-8b9b-41d6-8a60-223c12e248d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:34:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eaa4785-396e-465a-9300-98ee7c0f84b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eaa4785-396e-465a-9300-98ee7c0f84b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1973731111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ce5ad2-092b-4d0f-a944-3429718cdaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4739f173e3432181e489c0cf129c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:34:33Z,use_quota=True,user_id='25f0c66486c44f23b95a75357b511252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9f7391-5862-4337-86b7-5f2796d2c93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9f7391-5862-4337-86b7-5f2796d2c93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e732593d-c409-4e3e-904d-3233c9d2191b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e732593d-c409-4e3e-904d-3233c9d2191b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ce5ad2-092b-4d0f-a944-3429718cdaa1', 'volume_name': 'volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c54732-e786-497e-8acf-62488a43ec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c54732-e786-497e-8acf-62488a43ec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa0e5e4-0661-409d-8808-678f722fb001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:33 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Volume 82ce5ad2-092b-4d0f-a944-3429718cdaa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1', 'volume_size': 1} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1973731111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ce5ad2-092b-4d0f-a944-3429718cdaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4739f173e3432181e489c0cf129c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:34:33Z,use_quota=True,user_id='25f0c66486c44f23b95a75357b511252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Creating volume 82ce5ad2-092b-4d0f-a944-3429718cdaa1 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:34:33 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:33 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1 1073741824 Sep 25 10:34:33 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:33 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1 1073741824" returned: 0 in 0.805s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:34:34 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1 Sep 25 10:34:34 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:34:34 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Sep 25 10:34:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1" returned: 0 in 0.330s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:34:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:34:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:34:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa0e5e4-0661-409d-8808-678f722fb001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b059960-3f32-43d8-8ee2-049d776eddab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:34:34 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Volume volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1 (82ce5ad2-092b-4d0f-a944-3429718cdaa1): created successfully Sep 25 10:34:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b059960-3f32-43d8-8ee2-049d776eddab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:34:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Flow 'volume_create_manager' (41984cfa-8b9b-41d6-8a60-223c12e248d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:34:34 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8a2f5d35-ff97-42f5-accb-43f111cb0a37 tempest-ServerActionsTestOtherA-873879825 None] Created volume successfully. Sep 25 10:34:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-37d5086e-771e-4f8c-9477-979cca9fb7d6 req-6437b184-a635-4654-8d73-0a16c582859a tempest-AttachVolumeNegativeTest-734399829 None] Terminate volume connection completed successfully. Sep 25 10:34:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-37d5086e-771e-4f8c-9477-979cca9fb7d6 req-6437b184-a635-4654-8d73-0a16c582859a tempest-AttachVolumeNegativeTest-734399829 None] Deleting attachment 82e9bbb5-7291-4758-85bd-6696186705b5. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:34:54 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=30,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:34:54 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=30,cinder:UPDATE=36,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:35:03 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:35:03 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:35:03 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.430s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 8 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:35:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:35:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-c518fe92-d42c-4c50-87f8-fa3dd70c1a08 req-70eab1f6-fb07-45df-9c21-3ddad9ef0da2 tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:35:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-c518fe92-d42c-4c50-87f8-fa3dd70c1a08 req-70eab1f6-fb07-45df-9c21-3ddad9ef0da2 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:35:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-c518fe92-d42c-4c50-87f8-fa3dd70c1a08 req-70eab1f6-fb07-45df-9c21-3ddad9ef0da2 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:35:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-c518fe92-d42c-4c50-87f8-fa3dd70c1a08 req-70eab1f6-fb07-45df-9c21-3ddad9ef0da2 tempest-ServerActionsTestOtherA-873879825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f7c9438-ddae-4b1c-9ec7-d3763df10381', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:35:24 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-c518fe92-d42c-4c50-87f8-fa3dd70c1a08 req-70eab1f6-fb07-45df-9c21-3ddad9ef0da2 tempest-ServerActionsTestOtherA-873879825 None] attachment_update completed successfully. Sep 25 10:35:29 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-fc8e01d8-8e4d-45c3-82dc-34eff93201d5 req-dab9899b-7069-4b19-96fb-61bb13763b1e tempest-ServerActionsTestOtherA-873879825 None] Terminate volume connection completed successfully. Sep 25 10:35:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-fc8e01d8-8e4d-45c3-82dc-34eff93201d5 req-dab9899b-7069-4b19-96fb-61bb13763b1e tempest-ServerActionsTestOtherA-873879825 None] Deleting attachment 9f7c9438-ddae-4b1c-9ec7-d3763df10381. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:35:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-fc8e01d8-8e4d-45c3-82dc-34eff93201d5 req-cc174de1-4275-4dbb-b071-b5eec9b8f337 tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:35:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-fc8e01d8-8e4d-45c3-82dc-34eff93201d5 req-cc174de1-4275-4dbb-b071-b5eec9b8f337 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:35:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-fc8e01d8-8e4d-45c3-82dc-34eff93201d5 req-cc174de1-4275-4dbb-b071-b5eec9b8f337 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:35:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-fc8e01d8-8e4d-45c3-82dc-34eff93201d5 req-cc174de1-4275-4dbb-b071-b5eec9b8f337 tempest-ServerActionsTestOtherA-873879825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ac80e12-9b8e-46c8-be98-9336217ae6d5', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:35:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-fc8e01d8-8e4d-45c3-82dc-34eff93201d5 req-cc174de1-4275-4dbb-b071-b5eec9b8f337 tempest-ServerActionsTestOtherA-873879825 None] attachment_update completed successfully. Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Flow 'volume_create_manager' (782eb530-e14c-4164-b308-8a6c79723c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa05717-4fc0-4e59-94d7-0014fe76e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa05717-4fc0-4e59-94d7-0014fe76e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-308551060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fb55bf-a113-466b-8085-6a2704572c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b2f562af234cabb703d483f54d920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:35:39Z,use_quota=True,user_id='2ac029b76464490fa1ef9b1a633b5402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43fb8ec-11bf-46df-a59e-36aba687e3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43fb8ec-11bf-46df-a59e-36aba687e3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ce9a21-c219-48d7-b56c-824417bd0ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ce9a21-c219-48d7-b56c-824417bd0ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49fb55bf-a113-466b-8085-6a2704572c53', 'volume_name': 'volume-49fb55bf-a113-466b-8085-6a2704572c53', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46990e1e-9cde-4793-8360-d7bd6d3fff44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46990e1e-9cde-4793-8360-d7bd6d3fff44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6051b146-9798-4801-8012-b75d9c4ce59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:39 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Volume 49fb55bf-a113-466b-8085-6a2704572c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49fb55bf-a113-466b-8085-6a2704572c53', 'volume_size': 1} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-308551060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fb55bf-a113-466b-8085-6a2704572c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b2f562af234cabb703d483f54d920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:35:39Z,use_quota=True,user_id='2ac029b76464490fa1ef9b1a633b5402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Creating volume 49fb55bf-a113-466b-8085-6a2704572c53 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:35:39 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:35:39 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53 1073741824 Sep 25 10:35:39 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:35:39 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53 1073741824" returned: 0 in 0.586s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:35:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:35:39 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53 Sep 25 10:35:39 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:35:40 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Sep 25 10:35:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53" returned: 0 in 0.266s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:35:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:35:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:35:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6051b146-9798-4801-8012-b75d9c4ce59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49fb55bf-a113-466b-8085-6a2704572c53', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d7579f-7b6e-4390-b209-78e271d3bc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:40 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Volume volume-49fb55bf-a113-466b-8085-6a2704572c53 (49fb55bf-a113-466b-8085-6a2704572c53): created successfully Sep 25 10:35:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d7579f-7b6e-4390-b209-78e271d3bc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Flow 'volume_create_manager' (782eb530-e14c-4164-b308-8a6c79723c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:35:40 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e3aad232-2963-4357-8084-c5ed0ab30a6e tempest-AttachVolumeTestJSON-1358842573 None] Created volume successfully. Sep 25 10:35:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-cd805ae1-1baa-499d-a47e-054cb237de87 req-b3cfe6d6-5c14-4af0-877f-4cf9eecad5bc tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:35:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-cd805ae1-1baa-499d-a47e-054cb237de87 req-b3cfe6d6-5c14-4af0-877f-4cf9eecad5bc tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:35:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-cd805ae1-1baa-499d-a47e-054cb237de87 req-b3cfe6d6-5c14-4af0-877f-4cf9eecad5bc tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:35:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-cd805ae1-1baa-499d-a47e-054cb237de87 req-b3cfe6d6-5c14-4af0-877f-4cf9eecad5bc tempest-AttachVolumeTestJSON-1358842573 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-49fb55bf-a113-466b-8085-6a2704572c53', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e585b414-fe86-4599-9180-f6a665a99c70', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:35:42 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-cd805ae1-1baa-499d-a47e-054cb237de87 req-b3cfe6d6-5c14-4af0-877f-4cf9eecad5bc tempest-AttachVolumeTestJSON-1358842573 None] attachment_update completed successfully. Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Flow 'volume_create_manager' (940eaabb-f203-4a61-8f20-2173fe77bc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9658d9d-57c6-4c99-bb9c-f3257100dbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9658d9d-57c6-4c99-bb9c-f3257100dbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1009995558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b4fd52-707d-44a2-b14e-4743a2afbceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83605dc8349546bd975c2e0b0c114a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:35:50Z,use_quota=True,user_id='b471b7d0c9084d77a94b2d0e20f55da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a9cd23-aeb2-4445-b767-a6b594a9b126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a9cd23-aeb2-4445-b767-a6b594a9b126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca13eac-4169-4e12-bf14-7c72d57be850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca13eac-4169-4e12-bf14-7c72d57be850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b4fd52-707d-44a2-b14e-4743a2afbceb', 'volume_name': 'volume-09b4fd52-707d-44a2-b14e-4743a2afbceb', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477ad936-b938-49cb-91ca-02636749b984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477ad936-b938-49cb-91ca-02636749b984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acf54e1-6c2d-4c6b-9b52-0c844527bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:50 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Volume 09b4fd52-707d-44a2-b14e-4743a2afbceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b4fd52-707d-44a2-b14e-4743a2afbceb', 'volume_size': 1} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1009995558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b4fd52-707d-44a2-b14e-4743a2afbceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83605dc8349546bd975c2e0b0c114a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:35:50Z,use_quota=True,user_id='b471b7d0c9084d77a94b2d0e20f55da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Creating volume 09b4fd52-707d-44a2-b14e-4743a2afbceb {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:35:50 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:35:50 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb 1073741824 Sep 25 10:35:50 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:35:50 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Sep 25 10:35:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb 1073741824" returned: 0 in 0.682s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:35:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:35:51 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb Sep 25 10:35:51 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:35:51 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Sep 25 10:35:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb" returned: 0 in 0.309s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:35:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:35:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:35:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acf54e1-6c2d-4c6b-9b52-0c844527bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b4fd52-707d-44a2-b14e-4743a2afbceb', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafff8ca-0fc5-49a5-b15c-c3aadd852961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:35:51 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Volume volume-09b4fd52-707d-44a2-b14e-4743a2afbceb (09b4fd52-707d-44a2-b14e-4743a2afbceb): created successfully Sep 25 10:35:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafff8ca-0fc5-49a5-b15c-c3aadd852961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:35:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Flow 'volume_create_manager' (940eaabb-f203-4a61-8f20-2173fe77bc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:35:51 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-fdf66a9b-738b-4c68-8671-38599882fb5e tempest-AttachVolumeNegativeTest-734399829 None] Created volume successfully. Sep 25 10:35:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-482ee0ef-997b-4b29-9a35-bf92c1dbfa70 req-8e4a118e-f3ad-4814-a58d-ec0ac54b28fe tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:35:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-482ee0ef-997b-4b29-9a35-bf92c1dbfa70 req-8e4a118e-f3ad-4814-a58d-ec0ac54b28fe tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:35:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-482ee0ef-997b-4b29-9a35-bf92c1dbfa70 req-8e4a118e-f3ad-4814-a58d-ec0ac54b28fe tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:35:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-482ee0ef-997b-4b29-9a35-bf92c1dbfa70 req-8e4a118e-f3ad-4814-a58d-ec0ac54b28fe tempest-AttachVolumeNegativeTest-734399829 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-09b4fd52-707d-44a2-b14e-4743a2afbceb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faddf2ea-2573-4e8c-982a-e5ddec0dc135', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:35:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-482ee0ef-997b-4b29-9a35-bf92c1dbfa70 req-8e4a118e-f3ad-4814-a58d-ec0ac54b28fe tempest-AttachVolumeNegativeTest-734399829 None] attachment_update completed successfully. Sep 25 10:35:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-5ff4802a-511d-4591-a632-72d7e9444644 req-7df61c88-f1b4-493c-b790-2b98e943d2a0 tempest-AttachVolumeNegativeTest-734399829 None] Terminate volume connection completed successfully. Sep 25 10:35:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-5ff4802a-511d-4591-a632-72d7e9444644 req-7df61c88-f1b4-493c-b790-2b98e943d2a0 tempest-AttachVolumeNegativeTest-734399829 None] Deleting attachment faddf2ea-2573-4e8c-982a-e5ddec0dc135. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Flow 'volume_create_manager' (0db8d4a9-9de1-40d2-a8b3-123aa5328d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c891d4a0-2f38-410f-be43-b94e75705fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c891d4a0-2f38-410f-be43-b94e75705fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-495654542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c75e02-503b-4acb-ad4e-29f0aa67758f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f74e2359ed42f7957ad6f0473e3c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:36:03Z,use_quota=True,user_id='04b57d4b71eb4e6bab5e59bc2164cfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b46e23f-010a-4c57-925e-06f90da79757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b46e23f-010a-4c57-925e-06f90da79757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96087402-7261-4383-96db-fe13c24513b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96087402-7261-4383-96db-fe13c24513b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c75e02-503b-4acb-ad4e-29f0aa67758f', 'volume_name': 'volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3974243e-a246-4e8f-a468-27fc9ca34a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3974243e-a246-4e8f-a468-27fc9ca34a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af380d75-a3d3-413a-9745-b0530da1080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:03 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Volume b2c75e02-503b-4acb-ad4e-29f0aa67758f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f', 'volume_size': 1} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-495654542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c75e02-503b-4acb-ad4e-29f0aa67758f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f74e2359ed42f7957ad6f0473e3c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:36:03Z,use_quota=True,user_id='04b57d4b71eb4e6bab5e59bc2164cfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Creating volume b2c75e02-503b-4acb-ad4e-29f0aa67758f {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:36:03 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:03 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f 1073741824 Sep 25 10:36:03 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:03 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:36:03 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:03 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f 1073741824" returned: 0 in 0.615s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:03 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.438s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 8 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:36:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:36:03 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f Sep 25 10:36:03 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:04 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f" returned: 0 in 0.369s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:36:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af380d75-a3d3-413a-9745-b0530da1080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0b9d03-c981-4305-bb9c-54b3be5f1119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:04 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Volume volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f (b2c75e02-503b-4acb-ad4e-29f0aa67758f): created successfully Sep 25 10:36:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0b9d03-c981-4305-bb9c-54b3be5f1119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Flow 'volume_create_manager' (0db8d4a9-9de1-40d2-a8b3-123aa5328d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:36:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e638a494-f0f6-422a-bdbe-964dcc9fc009 tempest-AttachVolumeShelveTestJSON-1866585970 None] Created volume successfully. Sep 25 10:36:14 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=35,cinder:UPDATE=15,cinder:INSERT=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:36:14 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=33,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=3 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:36:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-c12fb4dd-c94a-4c91-9a4a-82f83af1a9ae req-d2b2e7f6-288b-4bca-bf03-4e1cd56d5a88 tempest-ServerActionsTestOtherA-873879825 None] Terminate volume connection completed successfully. Sep 25 10:36:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-c12fb4dd-c94a-4c91-9a4a-82f83af1a9ae req-d2b2e7f6-288b-4bca-bf03-4e1cd56d5a88 tempest-ServerActionsTestOtherA-873879825 None] Deleting attachment 4ac80e12-9b8e-46c8-be98-9336217ae6d5. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:36:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-49849961-a368-4f18-9bf4-12047186a38e req-66d1682d-bada-473d-8ab8-469269b4652b tempest-AttachVolumeTestJSON-1358842573 None] Terminate volume connection completed successfully. Sep 25 10:36:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-49849961-a368-4f18-9bf4-12047186a38e req-66d1682d-bada-473d-8ab8-469269b4652b tempest-AttachVolumeTestJSON-1358842573 None] Deleting attachment e585b414-fe86-4599-9180-f6a665a99c70. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:36:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-ab080626-4c41-4dac-9f2a-ad3abc2cbf9f req-e84d0457-bf5d-44e1-9225-15559909cec5 tempest-AttachVolumeShelveTestJSON-1866585970 None] No connector for attachment 62eae5e7-9c28-440f-ade9-9bb1b5110642; skipping storage backend terminate_connection call. {{(pid=87242) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 10:36:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-ab080626-4c41-4dac-9f2a-ad3abc2cbf9f req-e84d0457-bf5d-44e1-9225-15559909cec5 tempest-AttachVolumeShelveTestJSON-1866585970 None] Deleting attachment 62eae5e7-9c28-440f-ade9-9bb1b5110642. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:36:27 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=3 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:36:27 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=3 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Flow 'volume_create_manager' (a1026fd5-d3d6-44bc-89a5-87a4b86450e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2e6bcd-deec-4e7d-9ad5-22b0b0fbac04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2e6bcd-deec-4e7d-9ad5-22b0b0fbac04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1774954528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4739f173e3432181e489c0cf129c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:36:29Z,use_quota=True,user_id='25f0c66486c44f23b95a75357b511252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd88d2d9-09de-4a91-bba9-12fc05ccc09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd88d2d9-09de-4a91-bba9-12fc05ccc09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94cfc6f-74c7-43f6-a189-56897fb404dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.image.glance [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Creating Keystone auth plugin from conf {{(pid=87242) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94cfc6f-74c7-43f6-a189-56897fb404dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7', 'volume_name': 'volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354ccadc-4e99-4c67-930a-b56825195a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354ccadc-4e99-4c67-930a-b56825195a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ebd8e3-45b3-4a36-ae4b-b58379b97802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:29 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Volume 0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 10:36:29 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Trying to clone 0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 from image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]). {{(pid=87242) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:36:30 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:36:30 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Image download 20.69 MB at 20.69 MB/s Sep 25 10:36:30 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5c3d38-e8b3-4d32-a519-cf1b877ca3de]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:36:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:30 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD Sep 25 10:36:30 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:30 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:30 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Temporary image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c is fetched for user 25f0c66486c44f23b95a75357b511252. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6253a0f3-4ce8-4dba-a5df-10adddad39ea]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:31 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD Sep 25 10:36:31 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:31 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1774954528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4739f173e3432181e489c0cf129c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:36:29Z,use_quota=True,user_id='25f0c66486c44f23b95a75357b511252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Creating volume 0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:36:31 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:36:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:31 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 1073741824 Sep 25 10:36:31 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:32 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 1073741824" returned: 0 in 0.744s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:32 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 Sep 25 10:36:32 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:32 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7" returned: 0 in 0.287s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:36:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:32 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Attempting download of 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c ((None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}])) to volume 0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 10:36:32 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2313a030-27a4-4da9-a8a1-c5ef19b9b434]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:36:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_xblozw1t {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:32 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_xblozw1t Sep 25 10:36:32 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:33 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_xblozw1t" returned: 0 in 0.413s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_xblozw1t {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:33 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_xblozw1t Sep 25 10:36:33 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:33 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_xblozw1t" returned: 1 in 0.517s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_xblozw1t' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:36:33 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d7fa19-6561-4222-a9cc-d2992557df8e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:36:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:33 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD Sep 25 10:36:33 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:34 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD" returned: 0 in 0.868s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:34 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c was qcow2, converting to qcow2 {{(pid=87242) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:36:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:34 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 Sep 25 10:36:34 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:38 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7" returned: 0 in 4.093s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:38 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_rcqbs_htdevstack@QuobyteHD, size 112.00 MB, duration 4.10 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:36:38 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Converted 112.00 MB image at 27.29 MB/s Sep 25 10:36:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:38 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 1G Sep 25 10:36:38 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Flow 'volume_create_manager' (763b3b45-4326-46d8-a650-601bb71dfe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abbad4c-d3e4-4143-a67e-38cab911e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abbad4c-d3e4-4143-a67e-38cab911e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1563153745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e466af6-1351-4dd0-b4d4-bc0d50f20aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83605dc8349546bd975c2e0b0c114a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:36:39Z,use_quota=True,user_id='b471b7d0c9084d77a94b2d0e20f55da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf3058d-a3c9-4432-b2b8-13e9e6314dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf3058d-a3c9-4432-b2b8-13e9e6314dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f65d76e-6811-4760-bbde-380cfb8b7568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f65d76e-6811-4760-bbde-380cfb8b7568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e466af6-1351-4dd0-b4d4-bc0d50f20aa5', 'volume_name': 'volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4e78f4-3e73-4881-a147-5b9f6698ce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4e78f4-3e73-4881-a147-5b9f6698ce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2428981-a05b-4b21-b32a-e885f1232acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:39 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Volume 7e466af6-1351-4dd0-b4d4-bc0d50f20aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5', 'volume_size': 1} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1563153745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e466af6-1351-4dd0-b4d4-bc0d50f20aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83605dc8349546bd975c2e0b0c114a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:36:39Z,use_quota=True,user_id='b471b7d0c9084d77a94b2d0e20f55da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Creating volume 7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:36:39 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:39 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 1073741824 Sep 25 10:36:39 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:39 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 1G" returned: 0 in 0.806s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Downloaded image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c ((None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}])) to volume 0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 successfully. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Temporary image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c for user 25f0c66486c44f23b95a75357b511252 is deleted. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Marking volume 0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 as bootable. {{(pid=87242) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Copying metadata from image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c to 0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7. {{(pid=87242) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Creating volume glance metadata for volume 0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 backed by image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87242) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ebd8e3-45b3-4a36-ae4b-b58379b97802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20fb7ca3-52ef-462a-a8ee-b677a1b821f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:39 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Volume volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 (0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7): created successfully Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20fb7ca3-52ef-462a-a8ee-b677a1b821f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Flow 'volume_create_manager' (a1026fd5-d3d6-44bc-89a5-87a4b86450e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:36:39 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d229ea12-0bbd-4297-97a8-92d7cc5fc73c tempest-ServerActionsTestOtherA-873879825 None] Created volume successfully. Sep 25 10:36:39 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 1073741824" returned: 0 in 0.761s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:40 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 Sep 25 10:36:40 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:40 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5" returned: 0 in 0.292s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:36:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2428981-a05b-4b21-b32a-e885f1232acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d4bb61-0222-457a-bb29-c468fd29183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:36:40 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Volume volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 (7e466af6-1351-4dd0-b4d4-bc0d50f20aa5): created successfully Sep 25 10:36:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d4bb61-0222-457a-bb29-c468fd29183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:36:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Flow 'volume_create_manager' (763b3b45-4326-46d8-a650-601bb71dfe4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:36:40 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ce0c036d-3e94-45d7-99d8-e113394064d8 tempest-AttachVolumeNegativeTest-734399829 None] Created volume successfully. Sep 25 10:36:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-edf29d6e-b736-4fb4-abfd-7b49b4d65a57 req-b09e86d8-ad2b-4787-b901-2adc39c60b75 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-edf29d6e-b736-4fb4-abfd-7b49b4d65a57 req-b09e86d8-ad2b-4787-b901-2adc39c60b75 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-edf29d6e-b736-4fb4-abfd-7b49b4d65a57 req-b09e86d8-ad2b-4787-b901-2adc39c60b75 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-edf29d6e-b736-4fb4-abfd-7b49b4d65a57 req-b09e86d8-ad2b-4787-b901-2adc39c60b75 tempest-AttachVolumeNegativeTest-734399829 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50b41ebf-2a3a-4d88-985c-93a99d4354e7', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:36:42 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-edf29d6e-b736-4fb4-abfd-7b49b4d65a57 req-b09e86d8-ad2b-4787-b901-2adc39c60b75 tempest-AttachVolumeNegativeTest-734399829 None] attachment_update completed successfully. Sep 25 10:36:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-3a38effb-98c1-49fd-a98e-6517a881d1c7 req-5a014e04-60f9-4e08-b017-345094dc6411 tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-3a38effb-98c1-49fd-a98e-6517a881d1c7 req-5a014e04-60f9-4e08-b017-345094dc6411 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-3a38effb-98c1-49fd-a98e-6517a881d1c7 req-5a014e04-60f9-4e08-b017-345094dc6411 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-3a38effb-98c1-49fd-a98e-6517a881d1c7 req-5a014e04-60f9-4e08-b017-345094dc6411 tempest-ServerActionsTestOtherA-873879825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5dba9776-44c4-499d-b49e-97a8ef660007', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:36:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-3a38effb-98c1-49fd-a98e-6517a881d1c7 req-5a014e04-60f9-4e08-b017-345094dc6411 tempest-ServerActionsTestOtherA-873879825 None] attachment_update completed successfully. Sep 25 10:36:46 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-9ac02f67-9699-4c81-b2c9-452473d1debd req-7e0b45cd-cb43-440b-803e-7102c49f852c tempest-AttachVolumeNegativeTest-734399829 None] Terminate volume connection completed successfully. Sep 25 10:36:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-9ac02f67-9699-4c81-b2c9-452473d1debd req-7e0b45cd-cb43-440b-803e-7102c49f852c tempest-AttachVolumeNegativeTest-734399829 None] Deleting attachment 50b41ebf-2a3a-4d88-985c-93a99d4354e7. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:36:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "cinder-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:36:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:36:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "cinder-quobyte-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:36:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-quobyte-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:36:53 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace679ab-137e-400b-8cf3-d0916616c4c8]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:36:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:54 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 Sep 25 10:36:54 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:54 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5" returned: 0 in 0.555s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:54 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5 Sep 25 10:36:54 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:54 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5" returned: 0 in 0.350s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-quobyte-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5" released by "delete_volume" :: held 0.986s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:36:54 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Created reservations ['dba5b562-c2fa-4d4b-a91a-f9974a715a1b', '7246b1cc-9340-4898-b5fa-e3fb73e6b7b5', '2201820d-f42a-4f2c-bd77-3ac22973a6fc', '62a75fd4-6cd6-499f-93d0-bc29a3a074db'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:36:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:36:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:36:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:55 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:36:55 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:55 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:55 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:36:55 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Deleted volume successfully. Sep 25 10:36:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a9be12e5-98fd-49dc-81fa-c5d275b64761 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-7e466af6-1351-4dd0-b4d4-bc0d50f20aa5-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:36:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "cinder-09b4fd52-707d-44a2-b14e-4743a2afbceb-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:36:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-09b4fd52-707d-44a2-b14e-4743a2afbceb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:36:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "cinder-quobyte-09b4fd52-707d-44a2-b14e-4743a2afbceb" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:36:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-quobyte-09b4fd52-707d-44a2-b14e-4743a2afbceb" acquired by "delete_volume" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:36:56 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ec226d-012d-4b08-ab3d-183e91073c95]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:36:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:56 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb Sep 25 10:36:56 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:56 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb" returned: 0 in 0.623s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:57 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb Sep 25 10:36:57 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:57 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09b4fd52-707d-44a2-b14e-4743a2afbceb" returned: 0 in 0.457s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-quobyte-09b4fd52-707d-44a2-b14e-4743a2afbceb" released by "delete_volume" :: held 1.145s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:36:57 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Created reservations ['50e15a49-0e71-4f24-91ca-3a0b2a3fa64b', 'c284c3f4-34b1-4f03-bd67-d280399b18b4', '58edfbeb-cb5a-4a49-98b4-c569a2c9539f', '64e9b7f6-8eee-4954-aa1d-10ecf0ddee75'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:36:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:36:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:36:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:36:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:36:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:36:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:57 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:36:57 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:58 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.447s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:58 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:36:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Deleted volume successfully. Sep 25 10:36:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4774231c-5b4c-4359-b53f-e666797689e4 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-09b4fd52-707d-44a2-b14e-4743a2afbceb-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:36:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "cinder-54325c52-869d-4b15-9701-c99c8c271dde-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:36:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-54325c52-869d-4b15-9701-c99c8c271dde-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:36:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "cinder-quobyte-54325c52-869d-4b15-9701-c99c8c271dde" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:36:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-quobyte-54325c52-869d-4b15-9701-c99c8c271dde" acquired by "delete_volume" :: waited 0.035s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:36:59 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edea9ef-2a78-40e6-b586-a4588a2d4b6f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:36:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:59 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde Sep 25 10:36:59 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:36:59 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 25 10:36:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde" returned: 0 in 0.602s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:36:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:36:59 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde Sep 25 10:36:59 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:00 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54325c52-869d-4b15-9701-c99c8c271dde" returned: 0 in 0.365s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-quobyte-54325c52-869d-4b15-9701-c99c8c271dde" released by "delete_volume" :: held 1.038s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Created reservations ['a210fbdf-404f-4f6a-8330-7f0a818a3968', '39c70484-b8d3-4bb8-9096-36b23a6ad573', 'fcd14f13-fbff-4f9d-a2b7-2b104b6a289b', 'f2e358ab-ebb6-416b-9358-b504b611dc63'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:00 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:00 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:00 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.264s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:00 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Deleted volume successfully. Sep 25 10:37:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1e1f1694-faeb-4d00-bb94-1c883f372323 tempest-AttachVolumeNegativeTest-734399829 None] Lock "cinder-54325c52-869d-4b15-9701-c99c8c271dde-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:01 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-b0c2c69f-dbce-4438-b903-287475dc3982 req-1b8f6257-5a79-4be8-b1b2-9ab4cb5ef718 tempest-ServerActionsTestOtherA-873879825 None] Terminate volume connection completed successfully. Sep 25 10:37:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-b0c2c69f-dbce-4438-b903-287475dc3982 req-1b8f6257-5a79-4be8-b1b2-9ab4cb5ef718 tempest-ServerActionsTestOtherA-873879825 None] Deleting attachment 5dba9776-44c4-499d-b49e-97a8ef660007. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:03 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:03 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:03 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.372s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-b0c2c69f-dbce-4438-b903-287475dc3982 req-cb7f7a49-c4dd-4866-8e26-49d178996257 tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-b0c2c69f-dbce-4438-b903-287475dc3982 req-cb7f7a49-c4dd-4866-8e26-49d178996257 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-b0c2c69f-dbce-4438-b903-287475dc3982 req-cb7f7a49-c4dd-4866-8e26-49d178996257 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-b0c2c69f-dbce-4438-b903-287475dc3982 req-cb7f7a49-c4dd-4866-8e26-49d178996257 tempest-ServerActionsTestOtherA-873879825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1ef28ea-0835-457b-ba0a-9bbda8e601d0', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:37:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-b0c2c69f-dbce-4438-b903-287475dc3982 req-cb7f7a49-c4dd-4866-8e26-49d178996257 tempest-ServerActionsTestOtherA-873879825 None] attachment_update completed successfully. Sep 25 10:37:14 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=39,cinder:SELECT=48,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:37:14 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=49,cinder:INSERT=13,cinder:UPDATE=34,cinder:DELETE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:37:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5f79f06c-b61e-4425-96ca-0cfe1f147903 tempest-GroupsTest-459737835 None] Group tempest-Group1-1032242033: creating Sep 25 10:37:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5f79f06c-b61e-4425-96ca-0cfe1f147903 tempest-GroupsTest-459737835 None] Group tempest-Group1-1032242033: created successfully Sep 25 10:37:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5f79f06c-b61e-4425-96ca-0cfe1f147903 tempest-GroupsTest-459737835 None] Create group completed successfully. Sep 25 10:37:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ab8053cd-a8a4-40f8-8029-d18c90b04992 tempest-GroupsTest-459737835 None] Group tempest-Group2-695767711: creating Sep 25 10:37:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ab8053cd-a8a4-40f8-8029-d18c90b04992 tempest-GroupsTest-459737835 None] Group tempest-Group2-695767711: created successfully Sep 25 10:37:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ab8053cd-a8a4-40f8-8029-d18c90b04992 tempest-GroupsTest-459737835 None] Create group completed successfully. Sep 25 10:37:20 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Flow 'volume_create_manager' (2ad34942-2f8a-46c6-bf5c-e9a1802faca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8574149-df92-4f54-a960-8d22a1d98993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8574149-df92-4f54-a960-8d22a1d98993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899734294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c5b19a3-e05e-480f-b1da-88b4b5e24913,host='devstack@QuobyteHD#QuobyteHD',id=9974c63e-227c-47c7-93f1-12dc713bc926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc0412ffb9f41479b15b46104eee0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:21Z,use_quota=True,user_id='4df295a1b0cd4f1db83d46b4ca563095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96dc9ca4-8cf9-4edc-976c-8736e73b1e4d),volume_type_id=96dc9ca4-8cf9-4edc-976c-8736e73b1e4d)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51319c6a-0551-40cd-8860-5974ca5fe581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51319c6a-0551-40cd-8860-5974ca5fe581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe44da9a-00fe-4ec9-9b7e-0f08c481d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe44da9a-00fe-4ec9-9b7e-0f08c481d146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9974c63e-227c-47c7-93f1-12dc713bc926', 'volume_name': 'volume-9974c63e-227c-47c7-93f1-12dc713bc926', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d0854a-daa9-4674-b6c4-558a6e147268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d0854a-daa9-4674-b6c4-558a6e147268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a61500f-35c6-4d84-b81d-d423c3ee94c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:21 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Volume 9974c63e-227c-47c7-93f1-12dc713bc926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9974c63e-227c-47c7-93f1-12dc713bc926', 'volume_size': 1} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c5b19a3-e05e-480f-b1da-88b4b5e24913,created_at=2026-09-25T08:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899734294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c5b19a3-e05e-480f-b1da-88b4b5e24913,host='devstack@QuobyteHD#QuobyteHD',id=9974c63e-227c-47c7-93f1-12dc713bc926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc0412ffb9f41479b15b46104eee0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:21Z,use_quota=True,user_id='4df295a1b0cd4f1db83d46b4ca563095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96dc9ca4-8cf9-4edc-976c-8736e73b1e4d),volume_type_id=96dc9ca4-8cf9-4edc-976c-8736e73b1e4d)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Creating volume 9974c63e-227c-47c7-93f1-12dc713bc926 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:37:21 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:37:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:21 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926 1073741824 Sep 25 10:37:21 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:22 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926 1073741824" returned: 0 in 1.010s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:22 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926 Sep 25 10:37:22 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:22 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926" returned: 0 in 0.529s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:37:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a61500f-35c6-4d84-b81d-d423c3ee94c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9974c63e-227c-47c7-93f1-12dc713bc926', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac520f10-e86d-4b22-bd84-80d26cbd5d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:22 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Volume volume-9974c63e-227c-47c7-93f1-12dc713bc926 (9974c63e-227c-47c7-93f1-12dc713bc926): created successfully Sep 25 10:37:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac520f10-e86d-4b22-bd84-80d26cbd5d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Flow 'volume_create_manager' (2ad34942-2f8a-46c6-bf5c-e9a1802faca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c8eb280d-1d19-4769-9996-1dcb7b3235b7 tempest-GroupsTest-459737835 None] Created volume successfully. Sep 25 10:37:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Acquiring lock "cinder-quobyte-9974c63e-227c-47c7-93f1-12dc713bc926" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Lock "cinder-quobyte-9974c63e-227c-47c7-93f1-12dc713bc926" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:25 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd62ba5d-6c0f-441f-acb3-6dffa67b11a2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:37:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:25 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926 Sep 25 10:37:25 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Acquiring lock "cinder-b2c75e02-503b-4acb-ad4e-29f0aa67758f-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Lock "cinder-b2c75e02-503b-4acb-ad4e-29f0aa67758f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Acquiring lock "cinder-quobyte-b2c75e02-503b-4acb-ad4e-29f0aa67758f" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Lock "cinder-quobyte-b2c75e02-503b-4acb-ad4e-29f0aa67758f" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:26 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[627e821b-8dac-4a41-87bc-f2b980f6ee70]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:37:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:26 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926" returned: 0 in 0.724s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:26 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926 Sep 25 10:37:26 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:26 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f Sep 25 10:37:26 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:26 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9974c63e-227c-47c7-93f1-12dc713bc926" returned: 0 in 0.373s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Lock "cinder-quobyte-9974c63e-227c-47c7-93f1-12dc713bc926" released by "delete_volume" :: held 1.211s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:26 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f" returned: 0 in 0.651s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:26 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Created reservations ['d4b44c3b-b0a8-4cad-943f-f8d361e257a8'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:26 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f Sep 25 10:37:26 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:26 devstack cinder-volume[87242]: WARNING cinder.quota [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1769147528 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1769147528, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:37:26 devstack cinder-volume[87242]: WARNING cinder.quota [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1769147528 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1769147528, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:37:26 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Created reservations ['6b2aacc5-6d52-4674-9102-8af088cc670a', '3bbd783c-7886-4863-a0fa-709d82c67b2f', '113665bf-d3df-4bd9-b2f7-c5dcbb92751b', '92225b61-193e-452d-9e4d-b69fb1b58b43'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:27 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:27 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:27 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b2c75e02-503b-4acb-ad4e-29f0aa67758f" returned: 0 in 0.749s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Lock "cinder-quobyte-b2c75e02-503b-4acb-ad4e-29f0aa67758f" released by "delete_volume" :: held 1.507s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Created reservations ['4f3cd4b4-f60a-4104-9bcf-a7b5f3daf8d7', '62d111e1-c64c-48d1-bf77-74d8e78b9a0f', 'ee520ac1-7efd-4cde-94ec-11b3562e9ac1', 'df55b03b-3bd7-4b6b-aec8-abbcb14b8a05'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:27 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.741s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:27 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:27 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:28 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3fd87068-fcb3-4d37-a8e9-e8449a8cf4c5 tempest-GroupsTest-459737835 None] Delete group completed successfully. Sep 25 10:37:28 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-329e6631-31de-4417-8270-d6eb5dfb6250 tempest-GroupsTest-459737835 None] Created reservations ['62cf3763-cfb1-4835-88b3-7dd3528776e5'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-329e6631-31de-4417-8270-d6eb5dfb6250 tempest-GroupsTest-459737835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-329e6631-31de-4417-8270-d6eb5dfb6250 tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-329e6631-31de-4417-8270-d6eb5dfb6250 tempest-GroupsTest-459737835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-329e6631-31de-4417-8270-d6eb5dfb6250 tempest-GroupsTest-459737835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-329e6631-31de-4417-8270-d6eb5dfb6250 tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-329e6631-31de-4417-8270-d6eb5dfb6250 tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:28 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.634s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:28 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Deleted volume successfully. Sep 25 10:37:28 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:28 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-be6a4496-0c96-4401-9a65-616a8913056a tempest-AttachVolumeShelveTestJSON-1866585970 None] Lock "cinder-b2c75e02-503b-4acb-ad4e-29f0aa67758f-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:28 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-329e6631-31de-4417-8270-d6eb5dfb6250 tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.376s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:28 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-329e6631-31de-4417-8270-d6eb5dfb6250 tempest-GroupsTest-459737835 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:28 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-329e6631-31de-4417-8270-d6eb5dfb6250 tempest-GroupsTest-459737835 None] Delete group completed successfully. Sep 25 10:37:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0607191e-5067-4301-8b78-2d6f2d79e9d0 tempest-GroupsTest-459737835 None] Group tempest-GroupsTest-Group-1839423130: creating Sep 25 10:37:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0607191e-5067-4301-8b78-2d6f2d79e9d0 tempest-GroupsTest-459737835 None] Group tempest-GroupsTest-Group-1839423130: created successfully Sep 25 10:37:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0607191e-5067-4301-8b78-2d6f2d79e9d0 tempest-GroupsTest-459737835 None] Create group completed successfully. Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Flow 'volume_create_manager' (0760f4dc-ae76-43a0-9404-4d48b8586d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4445653-287b-40b2-bd55-7165bbd42cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4445653-287b-40b2-bd55-7165bbd42cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-396236612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c06191d-2396-46a9-a62c-d847027eab4a,host='devstack@QuobyteHD#QuobyteHD',id=9935b390-164d-480a-9d70-84c441c5dffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc0412ffb9f41479b15b46104eee0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:33Z,use_quota=True,user_id='4df295a1b0cd4f1db83d46b4ca563095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf3d4235-c50c-4f02-8aac-9b92f2ffda89),volume_type_id=bf3d4235-c50c-4f02-8aac-9b92f2ffda89)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7351bd5c-f133-4e09-8f9d-3758b3cc0d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7351bd5c-f133-4e09-8f9d-3758b3cc0d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bc9b11-70e1-42b3-a1f4-5e1c7de60746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bc9b11-70e1-42b3-a1f4-5e1c7de60746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9935b390-164d-480a-9d70-84c441c5dffe', 'volume_name': 'volume-9935b390-164d-480a-9d70-84c441c5dffe', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af67c6fb-09c3-4330-9ebf-712ed902e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af67c6fb-09c3-4330-9ebf-712ed902e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83127900-d4b8-4a69-84c3-43de1b760c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:32 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Volume 9935b390-164d-480a-9d70-84c441c5dffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9935b390-164d-480a-9d70-84c441c5dffe', 'volume_size': 1} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c06191d-2396-46a9-a62c-d847027eab4a,created_at=2026-09-25T08:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-396236612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c06191d-2396-46a9-a62c-d847027eab4a,host='devstack@QuobyteHD#QuobyteHD',id=9935b390-164d-480a-9d70-84c441c5dffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc0412ffb9f41479b15b46104eee0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:33Z,use_quota=True,user_id='4df295a1b0cd4f1db83d46b4ca563095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf3d4235-c50c-4f02-8aac-9b92f2ffda89),volume_type_id=bf3d4235-c50c-4f02-8aac-9b92f2ffda89)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Creating volume 9935b390-164d-480a-9d70-84c441c5dffe {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:37:32 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:37:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:33 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe 1073741824 Sep 25 10:37:33 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:33 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe 1073741824" returned: 0 in 0.667s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:33 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe Sep 25 10:37:33 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:34 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe" returned: 0 in 0.351s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:37:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83127900-d4b8-4a69-84c3-43de1b760c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9935b390-164d-480a-9d70-84c441c5dffe', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5771404-273b-4bfa-ab0e-7f014841f5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:34 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Volume volume-9935b390-164d-480a-9d70-84c441c5dffe (9935b390-164d-480a-9d70-84c441c5dffe): created successfully Sep 25 10:37:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5771404-273b-4bfa-ab0e-7f014841f5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Flow 'volume_create_manager' (0760f4dc-ae76-43a0-9404-4d48b8586d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:34 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-46f3a8df-fc4e-4855-8ed3-8e688cb8d236 tempest-GroupsTest-459737835 None] Created volume successfully. Sep 25 10:37:36 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Flow 'volume_create_manager' (1be39a5d-e27b-46d2-963b-078a31028275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69e696d-f993-4486-b289-f6f08f121be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69e696d-f993-4486-b289-f6f08f121be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-999113976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c06191d-2396-46a9-a62c-d847027eab4a,host='devstack@QuobyteHD#QuobyteHD',id=ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc0412ffb9f41479b15b46104eee0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:37Z,use_quota=True,user_id='4df295a1b0cd4f1db83d46b4ca563095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf3d4235-c50c-4f02-8aac-9b92f2ffda89),volume_type_id=bf3d4235-c50c-4f02-8aac-9b92f2ffda89)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01f2796-ba7c-4446-a352-5bb815f20c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01f2796-ba7c-4446-a352-5bb815f20c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621d77f3-2074-43b5-8db8-4587f724c5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621d77f3-2074-43b5-8db8-4587f724c5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1', 'volume_name': 'volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a159a25f-0c0d-4283-a721-6996b231811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a159a25f-0c0d-4283-a721-6996b231811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e19ca67-c958-48d3-bb92-fdfbda2df604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:37 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Volume ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1', 'volume_size': 1} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c06191d-2396-46a9-a62c-d847027eab4a,created_at=2026-09-25T08:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-999113976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c06191d-2396-46a9-a62c-d847027eab4a,host='devstack@QuobyteHD#QuobyteHD',id=ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc0412ffb9f41479b15b46104eee0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:37Z,use_quota=True,user_id='4df295a1b0cd4f1db83d46b4ca563095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf3d4235-c50c-4f02-8aac-9b92f2ffda89),volume_type_id=bf3d4235-c50c-4f02-8aac-9b92f2ffda89)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Creating volume ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:37:37 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:37 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 1073741824 Sep 25 10:37:37 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:37 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 1073741824" returned: 0 in 0.713s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:38 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 Sep 25 10:37:38 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:38 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1" returned: 0 in 0.441s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:37:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e19ca67-c958-48d3-bb92-fdfbda2df604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec661a37-9b8f-4a92-861f-ae2c2318de9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:38 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Volume volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 (ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1): created successfully Sep 25 10:37:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec661a37-9b8f-4a92-861f-ae2c2318de9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Flow 'volume_create_manager' (1be39a5d-e27b-46d2-963b-078a31028275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:38 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4d56a6bb-c7b5-4e65-a758-abbd3617a8eb tempest-GroupsTest-459737835 None] Created volume successfully. Sep 25 10:37:39 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-37cecaf1-ac0c-430a-b019-b72b1e4e6d90 tempest-GroupsTest-459737835 None] Update group completed successfully. Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Flow 'volume_create_manager' (55673f71-f923-4ca4-b616-888161fe8bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f881da65-11d3-4f00-a7a9-47c9b2cff510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f881da65-11d3-4f00-a7a9-47c9b2cff510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2013377154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f180187-3f42-408e-ab2a-f9eca5a10827,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85973295cb4f4077bd03cfc647ae86e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:41Z,use_quota=True,user_id='2196eaaf7a3d4c98bc53f862a0b3e580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac365bf1-9d65-425f-b42b-0b624625e0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac365bf1-9d65-425f-b42b-0b624625e0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fe371b-1d76-4713-8044-7086fd306681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fe371b-1d76-4713-8044-7086fd306681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f180187-3f42-408e-ab2a-f9eca5a10827', 'volume_name': 'volume-8f180187-3f42-408e-ab2a-f9eca5a10827', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f27204-8d09-48a9-9272-9913045148f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f27204-8d09-48a9-9272-9913045148f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1b6254-ebe9-41a9-9404-2226da91a797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:41 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Volume 8f180187-3f42-408e-ab2a-f9eca5a10827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f180187-3f42-408e-ab2a-f9eca5a10827', 'volume_size': 1} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2013377154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f180187-3f42-408e-ab2a-f9eca5a10827,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85973295cb4f4077bd03cfc647ae86e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:41Z,use_quota=True,user_id='2196eaaf7a3d4c98bc53f862a0b3e580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Creating volume 8f180187-3f42-408e-ab2a-f9eca5a10827 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:37:41 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:41 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827 1073741824 Sep 25 10:37:41 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-74bb032e-a37c-4a29-9e24-f74aa7258ee5 tempest-GroupsTest-459737835 None] Update group completed successfully. Sep 25 10:37:41 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827 1073741824" returned: 0 in 0.472s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:41 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827 Sep 25 10:37:41 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:42 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827" returned: 0 in 0.326s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:37:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1b6254-ebe9-41a9-9404-2226da91a797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f180187-3f42-408e-ab2a-f9eca5a10827', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef3bd73-fd32-4df1-a505-fd2d4dcbd757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:42 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Volume volume-8f180187-3f42-408e-ab2a-f9eca5a10827 (8f180187-3f42-408e-ab2a-f9eca5a10827): created successfully Sep 25 10:37:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef3bd73-fd32-4df1-a505-fd2d4dcbd757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Flow 'volume_create_manager' (55673f71-f923-4ca4-b616-888161fe8bda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:42 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d708d35e-5a27-4eda-9cc8-7e5e16f20cd8 tempest-VolumesTestJSON-1182895184 None] Created volume successfully. Sep 25 10:37:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Acquiring lock "cinder-quobyte-9935b390-164d-480a-9d70-84c441c5dffe" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Lock "cinder-quobyte-9935b390-164d-480a-9d70-84c441c5dffe" acquired by "delete_volume" :: waited 0.035s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:43 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[733299ab-6f8e-4c6c-b41d-ee969e5e7099]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:37:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:43 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe Sep 25 10:37:43 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:43 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe" returned: 0 in 0.587s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:43 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe Sep 25 10:37:43 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:37:44 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Flow 'volume_create_manager' (f20f9d2a-a1ae-4759-9c3a-631808bb71ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5dcea0-bc00-4abe-86a3-82652faa15cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9935b390-164d-480a-9d70-84c441c5dffe" returned: 0 in 0.497s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5dcea0-bc00-4abe-86a3-82652faa15cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-138758494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85973295cb4f4077bd03cfc647ae86e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:44Z,use_quota=True,user_id='2196eaaf7a3d4c98bc53f862a0b3e580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c0fc59-ea71-4aae-8ce4-76f770941fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c0fc59-ea71-4aae-8ce4-76f770941fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba46de40-2a0f-4b74-a89a-7041225eb7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba46de40-2a0f-4b74-a89a-7041225eb7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0', 'volume_name': 'volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e0ad9e-d53b-44e2-98be-e3d9c9f2dab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e0ad9e-d53b-44e2-98be-e3d9c9f2dab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33796c83-94b8-43ef-971c-ebeed6d815ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:44 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Volume b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0', 'volume_size': 1} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-138758494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85973295cb4f4077bd03cfc647ae86e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:44Z,use_quota=True,user_id='2196eaaf7a3d4c98bc53f862a0b3e580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Creating volume b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:37:44 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Lock "cinder-quobyte-9935b390-164d-480a-9d70-84c441c5dffe" released by "delete_volume" :: held 1.207s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Acquiring lock "cinder-quobyte-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Lock "cinder-quobyte-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:44 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 1073741824 Sep 25 10:37:44 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a7a618-1af0-4979-9196-0f77f97d0899]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:44 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 Sep 25 10:37:44 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:44 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1" returned: 0 in 0.472s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:44 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 1073741824" returned: 0 in 0.580s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:44 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1 Sep 25 10:37:44 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:44 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 Sep 25 10:37:44 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:45 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1" returned: 0 in 0.316s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Lock "cinder-quobyte-ccfee2b7-cac3-4ef0-aaf5-6d912923f9e1" released by "delete_volume" :: held 0.858s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:45 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0" returned: 0 in 0.339s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33796c83-94b8-43ef-971c-ebeed6d815ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba4cf42-7a54-4d2f-b332-c01d3ffca7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:45 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Volume volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 (b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0): created successfully Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba4cf42-7a54-4d2f-b332-c01d3ffca7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Flow 'volume_create_manager' (f20f9d2a-a1ae-4759-9c3a-631808bb71ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Created reservations ['60c7cf53-27c7-4e93-bd45-3ea5a7915bdc'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:45 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-15fe67a9-8e2c-433b-b2cc-37f734486a96 tempest-VolumesTestJSON-1182895184 None] Created volume successfully. Sep 25 10:37:45 devstack cinder-volume[87242]: WARNING cinder.quota [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2104199421 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2104199421, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:37:45 devstack cinder-volume[87242]: WARNING cinder.quota [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2104199421 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2104199421, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Created reservations ['8f678fac-2178-499e-b57d-1295e3280c32', 'c765ce6d-0f6f-4c0d-a2cf-123dbce6e6ca', 'bfbf1d84-7f8a-4571-863d-9c5d3d557510', '6b461122-b033-465c-94eb-ba3e4baff55a'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Created reservations ['a327eaf6-2ec2-4ee5-8e67-556f242d339c', 'a7f567ea-bb35-4bfe-b69d-49ad1abc91b7', '5168f951-c351-44f0-9107-b7309cdcd088', '94d58f9b-6a94-4e0f-984d-3f3587de17da'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:45 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:45 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:45 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.314s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:45 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:45 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0c07e27d-d59c-4ada-b7f5-38b65c86bced tempest-GroupsTest-459737835 None] Delete group completed successfully. Sep 25 10:37:46 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:37:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Flow 'volume_create_manager' (cf2b7d7b-e4c9-4f51-9cd2-7e5100660a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f436c7a9-0b7e-42bb-b93d-59a9a2120a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f436c7a9-0b7e-42bb-b93d-59a9a2120a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1918722527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6441de11-c04e-4f9e-957d-bf9f25c91cf6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85973295cb4f4077bd03cfc647ae86e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:47Z,use_quota=True,user_id='2196eaaf7a3d4c98bc53f862a0b3e580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8a91f8-ff97-4bd3-b111-c7ec3c3e05cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8a91f8-ff97-4bd3-b111-c7ec3c3e05cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52342a23-6c0f-4760-a954-7eed57495aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52342a23-6c0f-4760-a954-7eed57495aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6441de11-c04e-4f9e-957d-bf9f25c91cf6', 'volume_name': 'volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46773970-f88d-4de1-b7fb-d55286549514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46773970-f88d-4de1-b7fb-d55286549514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9315e503-8704-4707-94ba-ef730bf43a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:47 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Volume 6441de11-c04e-4f9e-957d-bf9f25c91cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6', 'volume_size': 1} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1918722527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6441de11-c04e-4f9e-957d-bf9f25c91cf6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='85973295cb4f4077bd03cfc647ae86e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:47Z,use_quota=True,user_id='2196eaaf7a3d4c98bc53f862a0b3e580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Creating volume 6441de11-c04e-4f9e-957d-bf9f25c91cf6 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:37:47 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:47 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6 1073741824 Sep 25 10:37:47 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:47 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6 1073741824" returned: 0 in 0.569s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:47 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6 Sep 25 10:37:47 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:47 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6" returned: 0 in 0.282s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9315e503-8704-4707-94ba-ef730bf43a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f276dc-cb63-4ca9-8d5c-663619eb49ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:47 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Volume volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6 (6441de11-c04e-4f9e-957d-bf9f25c91cf6): created successfully Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f276dc-cb63-4ca9-8d5c-663619eb49ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Flow 'volume_create_manager' (cf2b7d7b-e4c9-4f51-9cd2-7e5100660a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:48 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-345f6849-a906-4172-a559-9f3115e3b029 tempest-VolumesTestJSON-1182895184 None] Created volume successfully. Sep 25 10:37:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Acquiring lock "cinder-6441de11-c04e-4f9e-957d-bf9f25c91cf6-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Lock "cinder-6441de11-c04e-4f9e-957d-bf9f25c91cf6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Acquiring lock "cinder-quobyte-6441de11-c04e-4f9e-957d-bf9f25c91cf6" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Lock "cinder-quobyte-6441de11-c04e-4f9e-957d-bf9f25c91cf6" acquired by "delete_volume" :: waited 0.015s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:50 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8aaa4a-b94c-44ab-880b-469b1df79c93]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:37:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:50 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6 Sep 25 10:37:50 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:50 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6" returned: 0 in 0.425s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:50 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6 Sep 25 10:37:50 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:51 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6441de11-c04e-4f9e-957d-bf9f25c91cf6" returned: 0 in 0.270s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Lock "cinder-quobyte-6441de11-c04e-4f9e-957d-bf9f25c91cf6" released by "delete_volume" :: held 0.760s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Created reservations ['913a7334-b6e3-4f1b-8075-f0c2b78c6b4d', 'f6982161-7aeb-40f2-90c5-52f956d9b7a0', '4fc50f17-82cb-44b1-8cdd-a4e98c45b058', '0cc16e93-d703-45c2-80e2-edaf7b33611b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:51 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:51 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Acquiring lock "cinder-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Lock "cinder-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Acquiring lock "cinder-quobyte-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Lock "cinder-quobyte-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0" acquired by "delete_volume" :: waited 0.017s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:51 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.400s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0c3eee-364e-448e-a4e6-511cbd243afe]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:51 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Deleted volume successfully. Sep 25 10:37:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cca8db7c-6743-4eb7-aee1-50b9a4e99dde tempest-VolumesTestJSON-1182895184 None] Lock "cinder-6441de11-c04e-4f9e-957d-bf9f25c91cf6-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:51 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 Sep 25 10:37:51 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:52 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0" returned: 0 in 0.578s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:52 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0 Sep 25 10:37:52 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:52 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0" returned: 0 in 0.458s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Lock "cinder-quobyte-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0" released by "delete_volume" :: held 1.122s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Created reservations ['157acadd-ce11-4395-afb1-577087525820', '710ba88d-4c61-4957-822a-c58a1e391ab8', '8d04f616-ece2-4dfa-a3b5-d030849fecc7', '9e9f7b1e-eb01-4c72-b321-d6dc63a2bedc'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:52 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:52 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:53 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.429s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:53 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Deleted volume successfully. Sep 25 10:37:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-80853db6-461c-44ee-80eb-fd01fb2821ea tempest-VolumesTestJSON-1182895184 None] Lock "cinder-b209f7c7-fc85-4ed3-b0f5-a7145baf3ae0-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Acquiring lock "cinder-8f180187-3f42-408e-ab2a-f9eca5a10827-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Lock "cinder-8f180187-3f42-408e-ab2a-f9eca5a10827-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Acquiring lock "cinder-quobyte-8f180187-3f42-408e-ab2a-f9eca5a10827" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Lock "cinder-quobyte-8f180187-3f42-408e-ab2a-f9eca5a10827" acquired by "delete_volume" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4d2af9-fc5e-4f00-8deb-0cc30ca10e21]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:37:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:54 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827 Sep 25 10:37:54 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:54 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827" returned: 0 in 0.526s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:54 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827 Sep 25 10:37:54 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:55 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f180187-3f42-408e-ab2a-f9eca5a10827" returned: 0 in 0.378s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Lock "cinder-quobyte-8f180187-3f42-408e-ab2a-f9eca5a10827" released by "delete_volume" :: held 0.989s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Created reservations ['e9ce9513-6103-4b28-a4ac-c2de2e061a06', '3b2eb193-6bfd-40b0-9e37-44969ef833c6', '0784955f-f7d0-4975-9624-a33423c6fdfe', '664f7a63-4be0-40f9-9a9c-56c17d3c50c4'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Flow 'volume_create_manager' (55399402-2261-4b98-b983-5b4ac0de3d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ad314e-f75e-40cd-9779-82f5e29d9136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ad314e-f75e-40cd-9779-82f5e29d9136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-250892056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c01d77f-1dea-4c9f-a83c-f4ae6a059805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b2f562af234cabb703d483f54d920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:55Z,use_quota=True,user_id='2ac029b76464490fa1ef9b1a633b5402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04b12c2-9c7b-4f22-83c6-f544728e7306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04b12c2-9c7b-4f22-83c6-f544728e7306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c65e72e-9803-4cf2-a632-cb72a551cabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c65e72e-9803-4cf2-a632-cb72a551cabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c01d77f-1dea-4c9f-a83c-f4ae6a059805', 'volume_name': 'volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb642cf-44b8-4f41-8f05-df58c0ee6cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb642cf-44b8-4f41-8f05-df58c0ee6cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8e8423-9b21-4a62-98d3-26067699f4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:55 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Volume 8c01d77f-1dea-4c9f-a83c-f4ae6a059805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805', 'volume_size': 1} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-250892056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c01d77f-1dea-4c9f-a83c-f4ae6a059805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b2f562af234cabb703d483f54d920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:37:55Z,use_quota=True,user_id='2ac029b76464490fa1ef9b1a633b5402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Creating volume 8c01d77f-1dea-4c9f-a83c-f4ae6a059805 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:37:55 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:55 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805 1073741824 Sep 25 10:37:55 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:55 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-1472974d-3a42-4431-a27d-836091c2f6db req-1e522060-52d5-4bbd-b263-1dceac46afb0 tempest-ServerActionsTestOtherA-873879825 None] Terminate volume connection completed successfully. Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-1472974d-3a42-4431-a27d-836091c2f6db req-1e522060-52d5-4bbd-b263-1dceac46afb0 tempest-ServerActionsTestOtherA-873879825 None] Deleting attachment c1ef28ea-0835-457b-ba0a-9bbda8e601d0. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:55 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:55 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "cinder-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Lock "cinder-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "cinder-quobyte-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Lock "cinder-quobyte-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:55 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.461s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:55 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:55 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Deleted volume successfully. Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3ceb52-64a3-431d-b0b5-dadac2734990]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cba13ee7-6f80-4860-8ccd-4217aa2c633b tempest-VolumesTestJSON-1182895184 None] Lock "cinder-8f180187-3f42-408e-ab2a-f9eca5a10827-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:56 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805 1073741824" returned: 0 in 0.796s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:56 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 Sep 25 10:37:56 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:56 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805 Sep 25 10:37:56 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:56 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7" returned: 0 in 0.609s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:56 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7 Sep 25 10:37:56 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:56 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805" returned: 0 in 0.457s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8e8423-9b21-4a62-98d3-26067699f4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb2eec4-3603-444d-902a-d590db3dcd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:37:56 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Volume volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805 (8c01d77f-1dea-4c9f-a83c-f4ae6a059805): created successfully Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb2eec4-3603-444d-902a-d590db3dcd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:37:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Flow 'volume_create_manager' (55399402-2261-4b98-b983-5b4ac0de3d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:37:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3b4afabe-0201-4d12-8fda-d36f39aaad1f tempest-AttachVolumeTestJSON-1358842573 None] Created volume successfully. Sep 25 10:37:57 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7" returned: 0 in 0.465s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Lock "cinder-quobyte-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7" released by "delete_volume" :: held 1.174s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "cinder-82ce5ad2-092b-4d0f-a944-3429718cdaa1-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG cinder.quota [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Created reservations ['7425f7b6-b4c0-49e2-9706-3ddf01371b7a', '7643bdb8-ac5b-49ef-843b-68ab53c31574', 'ec997168-f343-4a68-8100-f98ec7804026', '32009eb7-4173-44fe-81a3-233ace2bf1e8'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Lock "cinder-82ce5ad2-092b-4d0f-a944-3429718cdaa1-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "cinder-quobyte-82ce5ad2-092b-4d0f-a944-3429718cdaa1" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Lock "cinder-quobyte-82ce5ad2-092b-4d0f-a944-3429718cdaa1" acquired by "delete_volume" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d2fc44-a6d1-4473-9ee5-090669e34283]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:57 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:57 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:57 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1 Sep 25 10:37:57 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:57 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.482s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:57 devstack cinder-volume[87242]: DEBUG cinder.manager [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Deleted volume successfully. Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1472974d-3a42-4431-a27d-836091c2f6db req-a96ee743-eda2-44be-b411-dd6af9e770d7 tempest-ServerActionsTestOtherA-873879825 None] Lock "cinder-0b8b6e5a-22aa-46b5-bbfd-c8989d4979f7-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:58 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1" returned: 0 in 0.768s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:58 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1 Sep 25 10:37:58 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:58 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-82ce5ad2-092b-4d0f-a944-3429718cdaa1" returned: 0 in 0.411s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-d457bef7-38ed-4e0a-8058-ff5215172ebc req-821b9bfd-f5a5-4c99-a95d-6576a06be3c8 tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-d457bef7-38ed-4e0a-8058-ff5215172ebc req-821b9bfd-f5a5-4c99-a95d-6576a06be3c8 tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Lock "cinder-quobyte-82ce5ad2-092b-4d0f-a944-3429718cdaa1" released by "delete_volume" :: held 1.279s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-d457bef7-38ed-4e0a-8058-ff5215172ebc req-821b9bfd-f5a5-4c99-a95d-6576a06be3c8 tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-d457bef7-38ed-4e0a-8058-ff5215172ebc req-821b9bfd-f5a5-4c99-a95d-6576a06be3c8 tempest-AttachVolumeTestJSON-1358842573 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5221e8a-aaac-4690-a019-6aeb2d1216ec', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Created reservations ['6c028522-6917-43d4-bf9d-c83978408830', '5e2e37af-0519-4c45-b71e-ec00b188d939', '4200e95b-92f4-4271-bdd3-414fd66e0da3', '77fee1ce-e605-427c-b097-19708e579354'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:37:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-d457bef7-38ed-4e0a-8058-ff5215172ebc req-821b9bfd-f5a5-4c99-a95d-6576a06be3c8 tempest-AttachVolumeTestJSON-1358842573 None] attachment_update completed successfully. Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:37:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:37:58 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:37:58 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:37:59 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Sep 25 10:37:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.421s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:37:59 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:37:59 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Deleted volume successfully. Sep 25 10:37:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51448174-ea41-43c7-8eb7-fe91c6d51fec tempest-ServerActionsTestOtherA-873879825 None] Lock "cinder-82ce5ad2-092b-4d0f-a944-3429718cdaa1-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Flow 'volume_create_manager' (d19200f2-318b-4bb3-846a-28d238b86211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e245f92-5bc8-420d-a589-89101e46ffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e245f92-5bc8-420d-a589-89101e46ffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-999082068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b2f562af234cabb703d483f54d920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:03Z,use_quota=True,user_id='2ac029b76464490fa1ef9b1a633b5402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdff187-e506-4238-8f5b-e2fe39f0e4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdff187-e506-4238-8f5b-e2fe39f0e4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c03219-607f-4c5b-8baa-f6e3be97c935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c03219-607f-4c5b-8baa-f6e3be97c935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16', 'volume_name': 'volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c281f40-0ca0-47f7-9c02-516486800c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c281f40-0ca0-47f7-9c02-516486800c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaef1e52-7598-4471-9091-29fd0fd291c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:02 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Volume 3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16', 'volume_size': 1} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-999082068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b2f562af234cabb703d483f54d920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:03Z,use_quota=True,user_id='2ac029b76464490fa1ef9b1a633b5402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Creating volume 3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:02 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:02 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 1073741824 Sep 25 10:38:02 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:03 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:03 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:03 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 1073741824" returned: 0 in 0.820s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:03 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 Sep 25 10:38:03 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:03 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.423s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:38:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:38:04 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16" returned: 0 in 0.415s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaef1e52-7598-4471-9091-29fd0fd291c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f38fe7c-f54b-4d28-8a9b-ffd7e8f5dcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:04 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Volume volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 (3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16): created successfully Sep 25 10:38:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f38fe7c-f54b-4d28-8a9b-ffd7e8f5dcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Flow 'volume_create_manager' (d19200f2-318b-4bb3-846a-28d238b86211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a1b2812b-3ee8-4b57-bfc6-a3835c6c8af3 tempest-AttachVolumeTestJSON-1358842573 None] Created volume successfully. Sep 25 10:38:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-f5f4ca80-65b4-4010-b589-b64ee11c9145 req-7c1b5861-acc9-41b5-9e9d-6c9fc0b7195e tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-f5f4ca80-65b4-4010-b589-b64ee11c9145 req-7c1b5861-acc9-41b5-9e9d-6c9fc0b7195e tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-f5f4ca80-65b4-4010-b589-b64ee11c9145 req-7c1b5861-acc9-41b5-9e9d-6c9fc0b7195e tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-f5f4ca80-65b4-4010-b589-b64ee11c9145 req-7c1b5861-acc9-41b5-9e9d-6c9fc0b7195e tempest-AttachVolumeTestJSON-1358842573 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef6e7de7-30ad-4a5c-a60d-e83e427fca09', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:38:06 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-f5f4ca80-65b4-4010-b589-b64ee11c9145 req-7c1b5861-acc9-41b5-9e9d-6c9fc0b7195e tempest-AttachVolumeTestJSON-1358842573 None] attachment_update completed successfully. Sep 25 10:38:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-6b58c411-02b6-49b7-a986-909d294e585a req-44d8b8c3-d61b-47f1-94bd-3f05e5e79668 tempest-AttachVolumeTestJSON-1358842573 None] Terminate volume connection completed successfully. Sep 25 10:38:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-6b58c411-02b6-49b7-a986-909d294e585a req-44d8b8c3-d61b-47f1-94bd-3f05e5e79668 tempest-AttachVolumeTestJSON-1358842573 None] Deleting attachment f5221e8a-aaac-4690-a019-6aeb2d1216ec. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Flow 'volume_create_manager' (4ff1ea30-36fc-43e5-9da5-6c274f13be33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d408fa-af3a-432e-bb87-201c81db2c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d408fa-af3a-432e-bb87-201c81db2c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1549926288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203aab45-ff9e-4dac-9d93-b116dde0eed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3763df99116467c990e761b0668a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:10Z,use_quota=True,user_id='90fc71bfe98349809d2a7baf8acf2f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf1b934-5d3a-4e5f-b44d-8573284dfab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf1b934-5d3a-4e5f-b44d-8573284dfab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f951ad49-9900-4a90-9836-4e1915207cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f951ad49-9900-4a90-9836-4e1915207cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '203aab45-ff9e-4dac-9d93-b116dde0eed8', 'volume_name': 'volume-203aab45-ff9e-4dac-9d93-b116dde0eed8', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb367f99-7d85-4d2c-ba6a-811605b3a157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb367f99-7d85-4d2c-ba6a-811605b3a157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97ad22e-f0fb-499c-a944-4cf7bfffe695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:10 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Volume 203aab45-ff9e-4dac-9d93-b116dde0eed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-203aab45-ff9e-4dac-9d93-b116dde0eed8', 'volume_size': 1} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1549926288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203aab45-ff9e-4dac-9d93-b116dde0eed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3763df99116467c990e761b0668a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:10Z,use_quota=True,user_id='90fc71bfe98349809d2a7baf8acf2f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Creating volume 203aab45-ff9e-4dac-9d93-b116dde0eed8 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:10 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:10 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8 1073741824 Sep 25 10:38:10 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-90769c04-33a8-410f-af94-c3f19a6d7564 tempest-BackendsCapabilitiesAdminTestsJSON-1913084896 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4611167907715, 'free_capacity_gb': 1775.4611167907715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87242) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-920459b8-d573-4dbb-8002-cf8ce1e29daa tempest-BackendsCapabilitiesAdminTestsJSON-1913084896 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4611167907715, 'free_capacity_gb': 1775.4611167907715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87242) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 10:38:11 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8 1073741824" returned: 0 in 0.926s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:11 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8 Sep 25 10:38:11 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:11 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8" returned: 0 in 0.393s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97ad22e-f0fb-499c-a944-4cf7bfffe695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203aab45-ff9e-4dac-9d93-b116dde0eed8', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e936f06-6cf7-4700-90e6-e380f2eee13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-5bdf1327-b63a-4245-b062-174f398e87b0 req-1395ba3c-a578-463a-9bca-1b1a89da28d0 tempest-AttachVolumeTestJSON-1358842573 None] Terminate volume connection completed successfully. Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-5bdf1327-b63a-4245-b062-174f398e87b0 req-1395ba3c-a578-463a-9bca-1b1a89da28d0 tempest-AttachVolumeTestJSON-1358842573 None] Deleting attachment ef6e7de7-30ad-4a5c-a60d-e83e427fca09. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:38:11 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Volume volume-203aab45-ff9e-4dac-9d93-b116dde0eed8 (203aab45-ff9e-4dac-9d93-b116dde0eed8): created successfully Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e936f06-6cf7-4700-90e6-e380f2eee13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Flow 'volume_create_manager' (4ff1ea30-36fc-43e5-9da5-6c274f13be33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-888941f8-4964-4bcd-84a2-d17fc40907fb tempest-VolumeQuotasAdminTestJSON-1183104141 None] Created volume successfully. Sep 25 10:38:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Acquiring lock "cinder-203aab45-ff9e-4dac-9d93-b116dde0eed8-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "cinder-203aab45-ff9e-4dac-9d93-b116dde0eed8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Acquiring lock "cinder-quobyte-203aab45-ff9e-4dac-9d93-b116dde0eed8" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "cinder-quobyte-203aab45-ff9e-4dac-9d93-b116dde0eed8" acquired by "delete_volume" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:12 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[933c0e64-0928-4162-b5e8-39b0e62b0c7f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:12 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8 Sep 25 10:38:12 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:13 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8" returned: 0 in 0.714s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:13 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8 Sep 25 10:38:13 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:13 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-203aab45-ff9e-4dac-9d93-b116dde0eed8" returned: 0 in 0.536s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "cinder-quobyte-203aab45-ff9e-4dac-9d93-b116dde0eed8" released by "delete_volume" :: held 1.330s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Created reservations ['4b239e3c-246f-4d16-af8c-830f4b418be7', 'fd6e2a7a-94e9-4fd6-a8e5-d503b76a73b2', '27769dba-07c0-49b1-a4bd-3a7cf6577d4a', '40737bcc-c1c9-4f7a-a8db-7000fd4102f4'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:14 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:14 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:14 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.301s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:14 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Deleted volume successfully. Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=97,cinder:UPDATE=116,cinder:DELETE=11,cinder:INSERT=27 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:38:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56582e2d-3d05-40dc-b19d-cc57d36f1f5d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "cinder-203aab45-ff9e-4dac-9d93-b116dde0eed8-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:15 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=112,cinder:UPDATE=129,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:38:15 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Flow 'volume_create_manager' (42e57a37-cb1f-4a4c-ae4a-3fa1375516dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbac9b76-a54f-433f-bb8a-ee50ced969f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbac9b76-a54f-433f-bb8a-ee50ced969f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2031128659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ae7886-5835-4093-af41-c1a5148ff230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3763df99116467c990e761b0668a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:16Z,use_quota=True,user_id='90fc71bfe98349809d2a7baf8acf2f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1ad1bc-3238-4c90-80a9-69b65909e63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1ad1bc-3238-4c90-80a9-69b65909e63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afad5d2-662b-4e74-ba70-dff31d0eb762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afad5d2-662b-4e74-ba70-dff31d0eb762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ae7886-5835-4093-af41-c1a5148ff230', 'volume_name': 'volume-57ae7886-5835-4093-af41-c1a5148ff230', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55459e7a-cb49-4350-a700-6b11a8f27d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55459e7a-cb49-4350-a700-6b11a8f27d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb66be8-6c7b-4027-9cf8-6949eab17774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:16 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Volume 57ae7886-5835-4093-af41-c1a5148ff230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ae7886-5835-4093-af41-c1a5148ff230', 'volume_size': 1} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2031128659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ae7886-5835-4093-af41-c1a5148ff230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3763df99116467c990e761b0668a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:16Z,use_quota=True,user_id='90fc71bfe98349809d2a7baf8acf2f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Creating volume 57ae7886-5835-4093-af41-c1a5148ff230 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:16 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:16 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230 1073741824 Sep 25 10:38:16 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:17 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230 1073741824" returned: 0 in 0.950s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:17 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230 Sep 25 10:38:17 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:17 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230" returned: 0 in 0.316s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb66be8-6c7b-4027-9cf8-6949eab17774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ae7886-5835-4093-af41-c1a5148ff230', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaca80b-1e88-4f3e-a7b9-4b4ed070ec25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:17 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Volume volume-57ae7886-5835-4093-af41-c1a5148ff230 (57ae7886-5835-4093-af41-c1a5148ff230): created successfully Sep 25 10:38:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaca80b-1e88-4f3e-a7b9-4b4ed070ec25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Flow 'volume_create_manager' (42e57a37-cb1f-4a4c-ae4a-3fa1375516dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-70def03e-f885-4783-b8fc-0c2b6982b90d tempest-VolumeQuotasAdminTestJSON-1183104141 None] Created volume successfully. Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Flow 'volume_create_manager' (081a002b-b0d4-4226-b173-e7f56ca06da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcd01b6-1194-4255-9c68-d595d3ccc802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcd01b6-1194-4255-9c68-d595d3ccc802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-991994218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897ea69e-c419-4e93-8451-e7645f82f2cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='237de45616074192b509df2375ffaeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:19Z,use_quota=True,user_id='75d3776cfeb94220b5b917d8c3890b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9fb6b1-0946-45a8-82bc-951f5dfae20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9fb6b1-0946-45a8-82bc-951f5dfae20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93521a6-f80b-48ba-aae7-99971e66b812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93521a6-f80b-48ba-aae7-99971e66b812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897ea69e-c419-4e93-8451-e7645f82f2cf', 'volume_name': 'volume-897ea69e-c419-4e93-8451-e7645f82f2cf', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44f4f48-5ca9-4d5d-8235-964c06fdb270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44f4f48-5ca9-4d5d-8235-964c06fdb270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855dc2f9-f750-4054-bdb9-19fd42db3a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:18 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Volume 897ea69e-c419-4e93-8451-e7645f82f2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897ea69e-c419-4e93-8451-e7645f82f2cf', 'volume_size': 1} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-991994218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897ea69e-c419-4e93-8451-e7645f82f2cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='237de45616074192b509df2375ffaeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:19Z,use_quota=True,user_id='75d3776cfeb94220b5b917d8c3890b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Creating volume 897ea69e-c419-4e93-8451-e7645f82f2cf {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:18 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:19 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf 1073741824 Sep 25 10:38:19 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:19 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4bde750e-4f34-4525-94b0-b459f5ecca85 tempest-VolumeQuotasAdminTestJSON-1761283750 None] Transfer volume completed successfully. Sep 25 10:38:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "cinder-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:19 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf 1073741824" returned: 0 in 0.706s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "cinder-quobyte-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-quobyte-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16" acquired by "delete_volume" :: waited 0.052s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:19 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf Sep 25 10:38:19 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:19 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98e201e-7c51-45e3-bafa-171c9e5a2d9c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:19 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 Sep 25 10:38:19 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:20 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf" returned: 0 in 0.364s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855dc2f9-f750-4054-bdb9-19fd42db3a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897ea69e-c419-4e93-8451-e7645f82f2cf', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2211680-2f57-4d06-915c-f0bf7567acf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Acquiring lock "cinder-57ae7886-5835-4093-af41-c1a5148ff230-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:20 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Volume volume-897ea69e-c419-4e93-8451-e7645f82f2cf (897ea69e-c419-4e93-8451-e7645f82f2cf): created successfully Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2211680-2f57-4d06-915c-f0bf7567acf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Flow 'volume_create_manager' (081a002b-b0d4-4226-b173-e7f56ca06da7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Lock "cinder-57ae7886-5835-4093-af41-c1a5148ff230-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-318a4167-10e2-4090-9740-e70e97f30122 req-d97bf843-191e-4577-8fde-a2c7fbda1377 tempest-VolumesGetTestJSON-623661221 None] Created volume successfully. Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Acquiring lock "cinder-quobyte-57ae7886-5835-4093-af41-c1a5148ff230" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Lock "cinder-quobyte-57ae7886-5835-4093-af41-c1a5148ff230" acquired by "delete_volume" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d98f12-32b8-43e9-a6d5-5fe6396283db]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:20 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16" returned: 0 in 0.522s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:20 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16 Sep 25 10:38:20 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:20 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230 Sep 25 10:38:20 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:20 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16" returned: 0 in 0.335s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-quobyte-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16" released by "delete_volume" :: held 0.944s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:20 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230" returned: 0 in 0.445s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:20 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230 Sep 25 10:38:20 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Created reservations ['91b4b824-e557-4ac0-ab4d-6ead046c42c0', '67c69b49-867d-474a-b2b6-bf678434bc2d', '4f1aad2b-4ffc-48d4-b673-2f6d1db3b6e8', 'c8821dba-d618-4a5c-9475-918f037fd996'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:21 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:21 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:21 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-57ae7886-5835-4093-af41-c1a5148ff230" returned: 0 in 0.396s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Lock "cinder-quobyte-57ae7886-5835-4093-af41-c1a5148ff230" released by "delete_volume" :: held 0.899s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Created reservations ['8ef8b52d-eefa-4f7f-bb9e-21e402dfc5b1', '63d69e79-808c-49a7-903b-b00b150e9103', 'e0c42440-7d0a-4422-aeb5-5e9792cdffad', '2a314735-e1e9-47ac-bd2f-8f366ce3280a'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:21 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.384s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Deleted volume successfully. Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-25899c67-df18-41b5-904a-83a5d9352763 tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-3b7a238f-0f4c-4f4f-88c6-472a9e5ffb16-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2fedfcbf-2691-4b16-967e-f68b8751017b tempest-GroupSnapshotsTest-705481147 None] Group tempest-GroupSnapshotsTest-Group-700397891: creating Sep 25 10:38:21 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:21 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2fedfcbf-2691-4b16-967e-f68b8751017b tempest-GroupSnapshotsTest-705481147 None] Group tempest-GroupSnapshotsTest-Group-700397891: created successfully Sep 25 10:38:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2fedfcbf-2691-4b16-967e-f68b8751017b tempest-GroupSnapshotsTest-705481147 None] Create group completed successfully. Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Acquiring lock "cinder-897ea69e-c419-4e93-8451-e7645f82f2cf-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Lock "cinder-897ea69e-c419-4e93-8451-e7645f82f2cf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Acquiring lock "cinder-quobyte-897ea69e-c419-4e93-8451-e7645f82f2cf" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Lock "cinder-quobyte-897ea69e-c419-4e93-8451-e7645f82f2cf" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0928be-c6e5-4995-a79f-2183fe6583ed]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:21 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.304s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Deleted volume successfully. Sep 25 10:38:21 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf Sep 25 10:38:21 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3147f6b7-4e32-41e0-bd20-63fc5a18f1ca tempest-VolumeQuotasAdminTestJSON-1008489070 None] Lock "cinder-57ae7886-5835-4093-af41-c1a5148ff230-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "cinder-8c01d77f-1dea-4c9f-a83c-f4ae6a059805-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-8c01d77f-1dea-4c9f-a83c-f4ae6a059805-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "cinder-quobyte-8c01d77f-1dea-4c9f-a83c-f4ae6a059805" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-quobyte-8c01d77f-1dea-4c9f-a83c-f4ae6a059805" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[009d753c-9f70-4a59-89ac-d74a6c301887]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:22 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf" returned: 0 in 0.430s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:22 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf Sep 25 10:38:22 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:22 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805 Sep 25 10:38:22 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:22 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-897ea69e-c419-4e93-8451-e7645f82f2cf" returned: 0 in 0.258s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Lock "cinder-quobyte-897ea69e-c419-4e93-8451-e7645f82f2cf" released by "delete_volume" :: held 0.742s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG cinder.quota [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Created reservations ['6f2e28cf-03fc-42a6-9eb8-0cbe34824ebf', 'd81c1a25-a8b2-49de-b92e-55f071829e07', 'bf916c9c-ab88-439c-bad6-9fc2f3f92032', '0730e952-6dba-4176-8d37-45725dac74e7'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:22 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805" returned: 0 in 0.498s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:22 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:22 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:22 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805 Sep 25 10:38:22 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:22 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.320s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG cinder.manager [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Deleted volume successfully. Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-7527f1cd-0549-4234-b433-f2fbcf76abd9 req-4ced2de6-bcd2-4205-ae95-8481e1859d78 tempest-VolumesGetTestJSON-623661221 None] Lock "cinder-897ea69e-c419-4e93-8451-e7645f82f2cf-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:22 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8c01d77f-1dea-4c9f-a83c-f4ae6a059805" returned: 0 in 0.405s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-quobyte-8c01d77f-1dea-4c9f-a83c-f4ae6a059805" released by "delete_volume" :: held 0.966s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Created reservations ['013c86d6-6bc3-4cc3-8f15-13dfc09bca01', 'b575aa18-4faf-4d32-9e4e-5e42421190c2', '5ac52c88-d0ac-447f-ace0-2bf7b137baa0', 'ec8b9d87-ff12-4264-9109-c9dc311b4465'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:23 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:23 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Flow 'volume_create_manager' (335a5e4b-91dd-41e0-afb7-79bc37f94b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e1fb87-360c-4900-ab6b-d09a0a45d4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e1fb87-360c-4900-ab6b-d09a0a45d4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1722491538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9a0c0d3-6812-429c-bb4a-e6a377a56d8d,host='devstack@QuobyteHD#QuobyteHD',id=e599430e-59ef-4769-8bf7-52c7f2e09e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635b019c109458da2d5504446fbf1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:23Z,use_quota=True,user_id='6082b7793ff44f218787de7545da863c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0861be6-13a8-46ee-ba64-8e3f3f429a26),volume_type_id=f0861be6-13a8-46ee-ba64-8e3f3f429a26)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1358438d-e24f-4c1c-8c6c-ef86e6bc5faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1358438d-e24f-4c1c-8c6c-ef86e6bc5faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3449d1f3-e5ea-4c87-a8e0-c5eab4413213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3449d1f3-e5ea-4c87-a8e0-c5eab4413213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e599430e-59ef-4769-8bf7-52c7f2e09e3f', 'volume_name': 'volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69759def-89a6-4e27-9d32-5de90c286971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69759def-89a6-4e27-9d32-5de90c286971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12fd280-626b-4f36-929c-00c57fa99c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:23 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Volume e599430e-59ef-4769-8bf7-52c7f2e09e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f', 'volume_size': 1} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9a0c0d3-6812-429c-bb4a-e6a377a56d8d,created_at=2026-09-25T08:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1722491538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9a0c0d3-6812-429c-bb4a-e6a377a56d8d,host='devstack@QuobyteHD#QuobyteHD',id=e599430e-59ef-4769-8bf7-52c7f2e09e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635b019c109458da2d5504446fbf1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:23Z,use_quota=True,user_id='6082b7793ff44f218787de7545da863c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0861be6-13a8-46ee-ba64-8e3f3f429a26),volume_type_id=f0861be6-13a8-46ee-ba64-8e3f3f429a26)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Creating volume e599430e-59ef-4769-8bf7-52c7f2e09e3f {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:23 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "cinder-49fb55bf-a113-466b-8085-6a2704572c53-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:23 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f 1073741824 Sep 25 10:38:23 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-49fb55bf-a113-466b-8085-6a2704572c53-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:23 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.399s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Deleted volume successfully. Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5e8f4d00-a9c9-48e3-8560-5e9fabdbf7e3 tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-8c01d77f-1dea-4c9f-a83c-f4ae6a059805-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "cinder-quobyte-49fb55bf-a113-466b-8085-6a2704572c53" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-quobyte-49fb55bf-a113-466b-8085-6a2704572c53" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7872d32f-042b-48c1-94a6-b4176de62717]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:23 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53 Sep 25 10:38:23 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:24 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f 1073741824" returned: 0 in 0.756s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:24 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53" returned: 0 in 0.560s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:24 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53 Sep 25 10:38:24 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:24 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f Sep 25 10:38:24 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:24 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-49fb55bf-a113-466b-8085-6a2704572c53" returned: 0 in 0.341s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-quobyte-49fb55bf-a113-466b-8085-6a2704572c53" released by "delete_volume" :: held 0.976s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:24 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f" returned: 0 in 0.414s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12fd280-626b-4f36-929c-00c57fa99c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (588e3199-ce84-48a2-aba9-8aac3380e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:24 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Volume volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f (e599430e-59ef-4769-8bf7-52c7f2e09e3f): created successfully Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (588e3199-ce84-48a2-aba9-8aac3380e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Flow 'volume_create_manager' (335a5e4b-91dd-41e0-afb7-79bc37f94b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:24 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Created reservations ['eb019f73-f845-419b-bbf8-b3dc3862d524', '7c04a324-d387-4978-b10e-c4b5fcdf1023', '1fc8e61e-40e1-452d-a63e-cfb9dafc88c3', '9e511dcf-a0cf-401c-8041-7b1c1e190bf9'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:24 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-bbf43041-026b-42bb-830e-8200e67fa103 tempest-GroupSnapshotsTest-705481147 None] Created volume successfully. Sep 25 10:38:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:25 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:25 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:25 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.322s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:25 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:25 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Deleted volume successfully. Sep 25 10:38:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e0933f25-6eab-4af3-8bf9-74364a03ccfa tempest-AttachVolumeTestJSON-1358842573 None] Lock "cinder-49fb55bf-a113-466b-8085-6a2704572c53-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:26 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] GroupSnapshot 14d8fd47-d5f1-4019-843d-18f84f716049: creating. Sep 25 10:38:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Group snapshot 14d8fd47-d5f1-4019-843d-18f84f716049: creating. {{(pid=87242) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 10:38:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Creating offline snapshot 661d4ffa-de38-4e28-afd4-1a8f102e930b of volume e599430e-59ef-4769-8bf7-52c7f2e09e3f {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:38:26 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8787c784-e1d1-48e6-bf5e-559a3c12eb7f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:26 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f Sep 25 10:38:26 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:27 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f" returned: 0 in 0.587s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:27 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b 1G Sep 25 10:38:27 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:27 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b 1G" returned: 0 in 0.654s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:27 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b Sep 25 10:38:27 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:28 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b" returned: 0 in 0.495s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:28 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:38:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:28 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b Sep 25 10:38:28 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:28 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b" returned: 0 in 0.354s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:28 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.info Sep 25 10:38:28 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:29 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.info" returned: 0 in 0.392s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:29 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:38:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:29 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.info Sep 25 10:38:29 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:29 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.info" returned: 0 in 0.418s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.067s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:29 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d5706c34-b0c6-4c7c-983c-8c53859ad4b5 tempest-GroupSnapshotsTest-705481147 None] group_snapshot 14d8fd47-d5f1-4019-843d-18f84f716049: created successfully Sep 25 10:38:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-31662b0d-48c4-43ec-bba6-f3e446bdd6c1 tempest-GroupSnapshotsV319Test-142392452 None] Group tempest-GroupSnapshotsV319Test-Group-1529969747: creating Sep 25 10:38:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-31662b0d-48c4-43ec-bba6-f3e446bdd6c1 tempest-GroupSnapshotsV319Test-142392452 None] Group tempest-GroupSnapshotsV319Test-Group-1529969747: created successfully Sep 25 10:38:31 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-31662b0d-48c4-43ec-bba6-f3e446bdd6c1 tempest-GroupSnapshotsV319Test-142392452 None] Create group completed successfully. Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-661d4ffa-de38-4e28-afd4-1a8f102e930b-852e90ce-73ca-4d1d-9d71-917776a3aa29" by "_create_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-661d4ffa-de38-4e28-afd4-1a8f102e930b-852e90ce-73ca-4d1d-9d71-917776a3aa29" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Creating volume 852e90ce-73ca-4d1d-9d71-917776a3aa29 from snapshot 661d4ffa-de38-4e28-afd4-1a8f102e930b {{(pid=87242) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-852e90ce-73ca-4d1d-9d71-917776a3aa29" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-852e90ce-73ca-4d1d-9d71-917776a3aa29" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] snapshot: 661d4ffa-de38-4e28-afd4-1a8f102e930b, volume: 852e90ce-73ca-4d1d-9d71-917776a3aa29, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:32 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdff5e28-6cd5-4765-9657-5111beb260f3]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:32 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b Sep 25 10:38:32 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:32 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b" returned: 0 in 0.748s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:38:32 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd21874e-5cc8-434d-bbbf-761a64ee804d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:32 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f Sep 25 10:38:32 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Flow 'volume_create_manager' (b01b32c6-53a0-40a8-bf4f-88e43678d29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6a2d1a-23f3-4ca4-9bbc-a26f031ba6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6a2d1a-23f3-4ca4-9bbc-a26f031ba6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-8151266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d2fc553-69fa-4f67-83ba-050552af4fa0,host='devstack@QuobyteHD#QuobyteHD',id=0834e2f3-4e30-41ac-8e2d-c9db81504355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de079741cc94726ab50f88bab07a0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:33Z,use_quota=True,user_id='93f11728127943afb48ccbb4988bfd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba07f85e-cf83-434c-abb7-ec22d54b06cc),volume_type_id=ba07f85e-cf83-434c-abb7-ec22d54b06cc)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1886d8bd-7320-4d84-b3f4-672eebfa3d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1886d8bd-7320-4d84-b3f4-672eebfa3d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f0c97b-a11b-4b2b-b4d3-23fc22549600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f0c97b-a11b-4b2b-b4d3-23fc22549600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0834e2f3-4e30-41ac-8e2d-c9db81504355', 'volume_name': 'volume-0834e2f3-4e30-41ac-8e2d-c9db81504355', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd604235-4870-4a10-8df4-a39d56c6be81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd604235-4870-4a10-8df4-a39d56c6be81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe08c9d6-f530-4d7c-83d9-289f83a83cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:33 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Volume 0834e2f3-4e30-41ac-8e2d-c9db81504355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0834e2f3-4e30-41ac-8e2d-c9db81504355', 'volume_size': 1} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:33 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f" returned: 0 in 0.520s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:38:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:33 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 Sep 25 10:38:33 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Flow 'volume_create_manager' (ae8fc90d-87a4-47fe-8014-6d1053b3b92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6622329-4909-471a-813c-e99cc1b63a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6622329-4909-471a-813c-e99cc1b63a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-528402590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a673c8-be8f-4336-9777-31645dfae837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35367ab5a47c4fd38df3a8e14e799219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:35Z,use_quota=True,user_id='57a1da86214349579f782bd391921b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a28510f-09fb-4704-955f-fe2f550dd42d),volume_type_id=6a28510f-09fb-4704-955f-fe2f550dd42d)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b7ef46-c20d-4363-9e2e-3ce8eacb4d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b7ef46-c20d-4363-9e2e-3ce8eacb4d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49556bd7-b87d-4d2f-8dd4-1f15a617424d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49556bd7-b87d-4d2f-8dd4-1f15a617424d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a673c8-be8f-4336-9777-31645dfae837', 'volume_name': 'volume-12a673c8-be8f-4336-9777-31645dfae837', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b38381-5db2-4dd1-9fea-868a09c9f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b38381-5db2-4dd1-9fea-868a09c9f750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f4caa0-a949-4608-8502-25ef5af04b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:35 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Volume 12a673c8-be8f-4336-9777-31645dfae837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a673c8-be8f-4336-9777-31645dfae837', 'volume_size': 1} Sep 25 10:38:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Flow 'volume_create_manager' (923517dc-433b-43a0-bd9b-49a5fc168254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ccc127-6924-49cb-9508-7613cf8b633e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ccc127-6924-49cb-9508-7613cf8b633e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1956777019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91271b95-72e9-4aa5-aac1-94a5881f86c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd265ab3f38146bd996393f7228a9d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:42Z,use_quota=True,user_id='669fd311b72547eaa52ba4ed1382f5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cee247-bb6d-48bd-9a0a-f0b68ab7c62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cee247-bb6d-48bd-9a0a-f0b68ab7c62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1a3849-a79f-4aab-93c9-900abdbc5832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1a3849-a79f-4aab-93c9-900abdbc5832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91271b95-72e9-4aa5-aac1-94a5881f86c7', 'volume_name': 'volume-91271b95-72e9-4aa5-aac1-94a5881f86c7', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1681d1-279a-464c-8905-a48ffc263cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1681d1-279a-464c-8905-a48ffc263cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0c2f5d-2929-4a35-b60b-bdd10ddca2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:41 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Volume 91271b95-72e9-4aa5-aac1-94a5881f86c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91271b95-72e9-4aa5-aac1-94a5881f86c7', 'volume_size': 1} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:41 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29" returned: 0 in 8.620s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f, size 1024.00 MB, duration 8.62 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:38:41 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Converted 1024.00 MB image at 118.78 MB/s Sep 25 10:38:41 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:38:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:41 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 Sep 25 10:38:41 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:42 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29" returned: 0 in 0.249s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-852e90ce-73ca-4d1d-9d71-917776a3aa29" released by "_copy_volume_from_snapshot" :: held 10.360s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-661d4ffa-de38-4e28-afd4-1a8f102e930b-852e90ce-73ca-4d1d-9d71-917776a3aa29" released by "_create_volume_from_snapshot" :: held 10.455s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.489s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.093s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d2fc553-69fa-4f67-83ba-050552af4fa0,created_at=2026-09-25T08:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-8151266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d2fc553-69fa-4f67-83ba-050552af4fa0,host='devstack@QuobyteHD#QuobyteHD',id=0834e2f3-4e30-41ac-8e2d-c9db81504355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de079741cc94726ab50f88bab07a0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:33Z,use_quota=True,user_id='93f11728127943afb48ccbb4988bfd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba07f85e-cf83-434c-abb7-ec22d54b06cc),volume_type_id=ba07f85e-cf83-434c-abb7-ec22d54b06cc)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Creating volume 0834e2f3-4e30-41ac-8e2d-c9db81504355 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:42 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:42 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 1073741824 Sep 25 10:38:42 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:42 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2cba99de-9678-443e-b8a4-dd458359ebf6 tempest-GroupSnapshotsTest-705481147 None] Create group from source-snapshot-14d8fd47-d5f1-4019-843d-18f84f716049 completed successfully. Sep 25 10:38:42 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 1073741824" returned: 0 in 0.521s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:42 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 Sep 25 10:38:42 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-852e90ce-73ca-4d1d-9d71-917776a3aa29" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-852e90ce-73ca-4d1d-9d71-917776a3aa29" acquired by "delete_volume" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3123a1ec-4bae-4e21-8e47-d4163870032d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:43 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355" returned: 0 in 0.283s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.681s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-528402590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a673c8-be8f-4336-9777-31645dfae837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35367ab5a47c4fd38df3a8e14e799219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:35Z,use_quota=True,user_id='57a1da86214349579f782bd391921b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a28510f-09fb-4704-955f-fe2f550dd42d),volume_type_id=6a28510f-09fb-4704-955f-fe2f550dd42d)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Creating volume 12a673c8-be8f-4336-9777-31645dfae837 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:43 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:43 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837 1073741824 Sep 25 10:38:43 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe08c9d6-f530-4d7c-83d9-289f83a83cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0834e2f3-4e30-41ac-8e2d-c9db81504355', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245992dd-2167-4104-8bde-293450149b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:43 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Volume volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 (0834e2f3-4e30-41ac-8e2d-c9db81504355): created successfully Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245992dd-2167-4104-8bde-293450149b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Flow 'volume_create_manager' (b01b32c6-53a0-40a8-bf4f-88e43678d29c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:43 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 Sep 25 10:38:43 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:43 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-430e5908-6edd-4060-be16-06bf22b006ce tempest-GroupSnapshotsV319Test-142392452 None] Created volume successfully. Sep 25 10:38:43 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29" returned: 0 in 0.390s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:43 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29 Sep 25 10:38:43 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:43 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837 1073741824" returned: 0 in 0.508s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:43 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837 Sep 25 10:38:43 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:43 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-852e90ce-73ca-4d1d-9d71-917776a3aa29" returned: 0 in 0.324s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:43 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] GroupSnapshot daab82b0-c3b0-4e35-b9d0-96e35402ba02: creating. Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-852e90ce-73ca-4d1d-9d71-917776a3aa29" released by "delete_volume" :: held 0.805s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Group snapshot daab82b0-c3b0-4e35-b9d0-96e35402ba02: creating. {{(pid=87242) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['4e863be1-07c2-4c17-9bf4-95b81a50e4ab'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:43 devstack cinder-volume[87242]: WARNING cinder.quota [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2112111399 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2112111399, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:38:43 devstack cinder-volume[87242]: WARNING cinder.quota [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2112111399 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2112111399, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:38:43 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['3b5b9b97-39f3-4e73-992e-7a0fb6281011', '734a429e-3058-425b-b90e-4cb382b77463', 'b54c8d52-57bf-43a7-940a-8a0d4a19b398', 'a75a7d43-6235-4b78-8b7d-a9466a2838bf'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:43 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837" returned: 0 in 0.301s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.154s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1956777019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91271b95-72e9-4aa5-aac1-94a5881f86c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd265ab3f38146bd996393f7228a9d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:42Z,use_quota=True,user_id='669fd311b72547eaa52ba4ed1382f5c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Creating volume 91271b95-72e9-4aa5-aac1-94a5881f86c7 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:44 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f4caa0-a949-4608-8502-25ef5af04b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a673c8-be8f-4336-9777-31645dfae837', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:44 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 1073741824 Sep 25 10:38:44 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87064d33-d2bd-41dc-893f-e95b63f8aa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:44 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Volume volume-12a673c8-be8f-4336-9777-31645dfae837 (12a673c8-be8f-4336-9777-31645dfae837): created successfully Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87064d33-d2bd-41dc-893f-e95b63f8aa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Flow 'volume_create_manager' (ae8fc90d-87a4-47fe-8014-6d1053b3b92b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f4369337-1e4e-48f4-be9c-ca6f9878afd3 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Created volume successfully. Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:44 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:44 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] group_snapshot 14d8fd47-d5f1-4019-843d-18f84f716049: deleting Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] group_snapshot 14d8fd47-d5f1-4019-843d-18f84f716049: deleting {{(pid=87242) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-e599430e-59ef-4769-8bf7-52c7f2e09e3f" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-e599430e-59ef-4769-8bf7-52c7f2e09e3f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-661d4ffa-de38-4e28-afd4-1a8f102e930b" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:44 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-661d4ffa-de38-4e28-afd4-1a8f102e930b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Deleting offline snapshot 661d4ffa-de38-4e28-afd4-1a8f102e930b of volume e599430e-59ef-4769-8bf7-52c7f2e09e3f {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] snapshot_file for this snap is: volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.360s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1e9e0225-0630-44d0-80e9-d7ebbc4a7ec5 tempest-GroupSnapshotsTest-705481147 None] Delete group completed successfully. Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[170f250a-cd4d-41a4-9d87-9340999504d2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:44 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 1073741824" returned: 0 in 0.598s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:44 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 Sep 25 10:38:44 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:44 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b Sep 25 10:38:44 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:44 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7" returned: 0 in 0.276s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.082s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0c2f5d-2929-4a35-b60b-bdd10ddca2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91271b95-72e9-4aa5-aac1-94a5881f86c7', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efe1866-f5a4-43ff-ba48-8a22a74d9638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:45 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Volume volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 (91271b95-72e9-4aa5-aac1-94a5881f86c7): created successfully Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efe1866-f5a4-43ff-ba48-8a22a74d9638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Flow 'volume_create_manager' (923517dc-433b-43a0-bd9b-49a5fc168254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:45 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Creating offline snapshot 5cdcc9fe-39b3-4c8c-aea0-e2109812d57f of volume 0834e2f3-4e30-41ac-8e2d-c9db81504355 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b" returned: 0 in 0.492s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:38:45 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-341c0c62-1202-43c2-a425-7f713f31923d req-7872ec10-8329-48bc-bb1b-49ecd28bae62 tempest-VolumesSnapshotsTestJSON-1982703681 None] Created volume successfully. Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c9559c-5075-45ae-8541-a32f00efbfef]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1163b78-ff41-4ad8-8765-c1a0807fb81d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:45 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 Sep 25 10:38:45 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:45 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f Sep 25 10:38:45 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d385743-73f5-47e6-ac74-949916415b60 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d385743-73f5-47e6-ac74-949916415b60 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8d385743-73f5-47e6-ac74-949916415b60 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8d385743-73f5-47e6-ac74-949916415b60 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d385743-73f5-47e6-ac74-949916415b60 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d385743-73f5-47e6-ac74-949916415b60 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:45 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:45 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:45 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355" returned: 0 in 0.406s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:45 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f 1G Sep 25 10:38:45 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:45 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d385743-73f5-47e6-ac74-949916415b60 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.277s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-8d385743-73f5-47e6-ac74-949916415b60 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:45 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8d385743-73f5-47e6-ac74-949916415b60 tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Retype volume completed successfully. Sep 25 10:38:45 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f" returned: 0 in 0.566s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:45 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b Sep 25 10:38:45 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:45 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f 1G" returned: 0 in 0.461s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:45 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f Sep 25 10:38:45 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:46 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b" returned: 0 in 0.430s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:46 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b Sep 25 10:38:46 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:46 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f" returned: 0 in 0.395s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:46 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:46 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f Sep 25 10:38:46 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:46 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f.661d4ffa-de38-4e28-afd4-1a8f102e930b" returned: 0 in 0.339s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Acquiring lock "cinder-12a673c8-be8f-4336-9777-31645dfae837-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-661d4ffa-de38-4e28-afd4-1a8f102e930b" released by "_delete_snapshot" :: held 2.006s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "cinder-12a673c8-be8f-4336-9777-31645dfae837-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-e599430e-59ef-4769-8bf7-52c7f2e09e3f" released by "delete_snapshot" :: held 2.058s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Acquiring lock "cinder-quobyte-12a673c8-be8f-4336-9777-31645dfae837" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "cinder-quobyte-12a673c8-be8f-4336-9777-31645dfae837" acquired by "delete_volume" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b4555e-7f79-4188-ad34-1c9ecda72a96]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:46 devstack cinder-volume[87242]: WARNING cinder.quota [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2112111399 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2112111399, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['0f629407-1209-406b-bda5-5dc678eed61d', '8345498d-9c8f-4620-b2a3-75e05f079451', '0a7ae4d0-6f2d-47de-89c8-9f020f92218d', 'd100133f-a91e-4c32-8545-8167c948540e'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:46 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f" returned: 0 in 0.385s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:46 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.info Sep 25 10:38:46 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:46 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837 Sep 25 10:38:46 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:46 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-39b779cd-5dda-4c2f-aa84-4146fd8c1860 tempest-GroupSnapshotsTest-705481147 None] group_snapshot 14d8fd47-d5f1-4019-843d-18f84f716049: deleted successfully Sep 25 10:38:47 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.info" returned: 0 in 0.306s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:47 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:47 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.info Sep 25 10:38:47 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:47 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837" returned: 0 in 0.476s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:47 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837 Sep 25 10:38:47 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:47 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.info" returned: 0 in 0.296s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.925s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:47 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Creating offline snapshot 89384c46-cd27-4c06-818d-0b277c025e7a of volume 91271b95-72e9-4aa5-aac1-94a5881f86c7 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12a673c8-be8f-4336-9777-31645dfae837" returned: 0 in 0.300s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb8af91-05a1-42da-ba03-f9c56fc117a0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "cinder-quobyte-12a673c8-be8f-4336-9777-31645dfae837" released by "delete_volume" :: held 0.856s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:47 devstack cinder-volume[87242]: WARNING cinder.quota [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:38:47 devstack cinder-volume[87242]: WARNING cinder.quota [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:38:47 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-48b05a3f-356c-459f-8db5-acc774532634 tempest-GroupSnapshotsV319Test-142392452 None] group_snapshot daab82b0-c3b0-4e35-b9d0-96e35402ba02: created successfully Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Created reservations ['52bb4f52-27af-4519-be0a-c7e2aac50038', '25048c44-0d91-4632-801a-7adef1454d4a', '301c95b0-fa54-4457-8059-5e4dd679c931', 'ef523424-88bb-4557-bb0c-42195732973b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:47 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 Sep 25 10:38:47 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:47 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:47 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:47 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7" returned: 0 in 0.449s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:47 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.292s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:47 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:47 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Deleted volume successfully. Sep 25 10:38:47 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a 1G Sep 25 10:38:47 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f8bec2b4-d1b2-46a5-afc2-569efd3c4b0b tempest-VolumeRetypeWithoutMigrationTest-464225689 None] Lock "cinder-12a673c8-be8f-4336-9777-31645dfae837-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-e599430e-59ef-4769-8bf7-52c7f2e09e3f" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-e599430e-59ef-4769-8bf7-52c7f2e09e3f" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e15b6d4-d401-40e3-a0cb-f8322efae69d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:48 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f Sep 25 10:38:48 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:48 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] group_snapshot daab82b0-c3b0-4e35-b9d0-96e35402ba02: deleting Sep 25 10:38:48 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] group_snapshot daab82b0-c3b0-4e35-b9d0-96e35402ba02: deleting {{(pid=87242) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a 1G" returned: 0 in 0.712s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:48 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a Sep 25 10:38:48 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Acquiring lock "cinder-quobyte-0834e2f3-4e30-41ac-8e2d-c9db81504355" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Lock "cinder-quobyte-0834e2f3-4e30-41ac-8e2d-c9db81504355" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Acquiring lock "cinder-quobyte-5cdcc9fe-39b3-4c8c-aea0-e2109812d57f" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Lock "cinder-quobyte-5cdcc9fe-39b3-4c8c-aea0-e2109812d57f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Deleting offline snapshot 5cdcc9fe-39b3-4c8c-aea0-e2109812d57f of volume 0834e2f3-4e30-41ac-8e2d-c9db81504355 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] snapshot_file for this snap is: volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a97d68-9e15-4ee2-90d5-588a9c284994]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:48 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f" returned: 0 in 0.581s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:49 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f Sep 25 10:38:49 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:49 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f Sep 25 10:38:49 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:49 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a" returned: 0 in 0.495s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:49 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a is being set with open permissions: ugo+rw Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:49 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a Sep 25 10:38:49 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:49 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f" returned: 0 in 0.467s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0834e2f3-4e30-41ac-8e2d-c9db81504355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:38:49 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e599430e-59ef-4769-8bf7-52c7f2e09e3f" returned: 0 in 0.360s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81f8869-68ff-4ed5-8f5f-d97dca416c24]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-e599430e-59ef-4769-8bf7-52c7f2e09e3f" released by "delete_volume" :: held 1.052s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:49 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a" returned: 0 in 0.276s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Created reservations ['dd7e0d64-0c26-402f-9168-e9bbbc52362c'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:49 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 Sep 25 10:38:49 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:49 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.info Sep 25 10:38:49 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:49 devstack cinder-volume[87242]: WARNING cinder.db.api [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2112111399'] Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Created reservations ['7c840114-33b0-4b69-b509-5feba7e77dd4', 'a822de08-2df6-48a0-9838-1e05b1ec1774', '337c886b-1cd6-4e4d-b322-ead5b8f6261d', 'ba6cfd76-ab51-46f9-b2bc-05429473fd4d'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:49 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:49 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:49 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.info" returned: 0 in 0.414s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:49 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.info is being set with open permissions: ugo+rw Sep 25 10:38:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:49 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.info Sep 25 10:38:49 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:50 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355" returned: 0 in 0.736s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:50 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f Sep 25 10:38:50 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:50 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.471s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:50 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f94264d0-2737-4df2-8463-fbe0ce50512e tempest-GroupSnapshotsTest-705481147 None] Delete group completed successfully. Sep 25 10:38:50 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.info" returned: 0 in 0.476s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.975s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-e1acbb81-c47c-4083-9500-f9bc27b0f84b req-20e130da-57d8-44d4-ae44-14d7f04933c8 tempest-VolumesSnapshotsTestJSON-1982703681 None] Create snapshot completed successfully Sep 25 10:38:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0847fdee-f1f0-4c3f-80d6-47da04cd6f2e tempest-GroupSnapshotsTest-705481147 None] Group tempest-GroupSnapshotsTest-Group-1271707119: creating Sep 25 10:38:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0847fdee-f1f0-4c3f-80d6-47da04cd6f2e tempest-GroupSnapshotsTest-705481147 None] Group tempest-GroupSnapshotsTest-Group-1271707119: created successfully Sep 25 10:38:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0847fdee-f1f0-4c3f-80d6-47da04cd6f2e tempest-GroupSnapshotsTest-705481147 None] Create group completed successfully. Sep 25 10:38:50 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f" returned: 0 in 0.554s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:50 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f Sep 25 10:38:50 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:50 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355.5cdcc9fe-39b3-4c8c-aea0-e2109812d57f" returned: 0 in 0.318s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Lock "cinder-quobyte-5cdcc9fe-39b3-4c8c-aea0-e2109812d57f" released by "_delete_snapshot" :: held 2.253s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Lock "cinder-quobyte-0834e2f3-4e30-41ac-8e2d-c9db81504355" released by "delete_snapshot" :: held 2.297s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:51 devstack cinder-volume[87242]: WARNING cinder.quota [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1227872361 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1227872361, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:38:51 devstack cinder-volume[87242]: WARNING cinder.quota [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1227872361 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1227872361, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] Created reservations ['85628ce7-f4c4-45b2-aeec-51a1e1311377', '038ea1fd-f86a-4f88-8950-b638397c6bf2', 'dd86ac3b-2571-4005-ba07-48e58d346c02', 'e9e992c8-ee51-406c-a9e4-02cea846aa7f'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Acquiring lock "cinder-89384c46-cd27-4c06-818d-0b277c025e7a-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "cinder-89384c46-cd27-4c06-818d-0b277c025e7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Acquiring lock "cinder-quobyte-91271b95-72e9-4aa5-aac1-94a5881f86c7" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "cinder-quobyte-91271b95-72e9-4aa5-aac1-94a5881f86c7" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Acquiring lock "cinder-quobyte-89384c46-cd27-4c06-818d-0b277c025e7a" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "cinder-quobyte-89384c46-cd27-4c06-818d-0b277c025e7a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Deleting offline snapshot 89384c46-cd27-4c06-818d-0b277c025e7a of volume 91271b95-72e9-4aa5-aac1-94a5881f86c7 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] snapshot_file for this snap is: volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb13dc8-af0e-46dc-89de-9ac0269ff36a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:51 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3ef4dcee-503b-4535-aed7-5996bf1e64dc tempest-GroupSnapshotsV319Test-142392452 None] group_snapshot daab82b0-c3b0-4e35-b9d0-96e35402ba02: deleted successfully Sep 25 10:38:51 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a Sep 25 10:38:51 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:51 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a" returned: 0 in 0.529s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91271b95-72e9-4aa5-aac1-94a5881f86c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8246401-be7c-4713-b99b-b61628d9ff1c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:52 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 Sep 25 10:38:52 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Acquiring lock "cinder-quobyte-0834e2f3-4e30-41ac-8e2d-c9db81504355" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Lock "cinder-quobyte-0834e2f3-4e30-41ac-8e2d-c9db81504355" acquired by "delete_volume" :: waited 0.057s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:52 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7" returned: 0 in 0.562s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cf0bf1-8211-4f4d-a007-0b107f80bf0e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:52 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a Sep 25 10:38:52 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Flow 'volume_create_manager' (d018478b-e2a7-47c8-b2db-4365cbdf0d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c76dac-ebd0-4b84-967a-3d2b3683ffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c76dac-ebd0-4b84-967a-3d2b3683ffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525307207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fb2b4c6-8ed1-48e2-8eea-a03479fbc54b,host='devstack@QuobyteHD#QuobyteHD',id=3f669e21-367f-4b32-9459-649120be01b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635b019c109458da2d5504446fbf1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:52Z,use_quota=True,user_id='6082b7793ff44f218787de7545da863c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d527b0e7-09b1-4b65-b947-26edb9b34845),volume_type_id=d527b0e7-09b1-4b65-b947-26edb9b34845)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a262d0-16d0-4fc0-bf6c-b324ef654bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a262d0-16d0-4fc0-bf6c-b324ef654bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af18de8e-e65e-489c-b8c8-453aa1eb46a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af18de8e-e65e-489c-b8c8-453aa1eb46a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f669e21-367f-4b32-9459-649120be01b1', 'volume_name': 'volume-3f669e21-367f-4b32-9459-649120be01b1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2f5c48-1b6e-486e-9dd5-32679c0654ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2f5c48-1b6e-486e-9dd5-32679c0654ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10e5fe1-f01c-4f70-acbe-d41c2ac12dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:52 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Volume 3f669e21-367f-4b32-9459-649120be01b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f669e21-367f-4b32-9459-649120be01b1', 'volume_size': 1} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8fb2b4c6-8ed1-48e2-8eea-a03479fbc54b,created_at=2026-09-25T08:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525307207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fb2b4c6-8ed1-48e2-8eea-a03479fbc54b,host='devstack@QuobyteHD#QuobyteHD',id=3f669e21-367f-4b32-9459-649120be01b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635b019c109458da2d5504446fbf1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:52Z,use_quota=True,user_id='6082b7793ff44f218787de7545da863c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d527b0e7-09b1-4b65-b947-26edb9b34845),volume_type_id=d527b0e7-09b1-4b65-b947-26edb9b34845)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Creating volume 3f669e21-367f-4b32-9459-649120be01b1 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:52 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:52 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 Sep 25 10:38:52 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:52 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 1073741824 Sep 25 10:38:52 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:53 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a" returned: 0 in 0.465s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:53 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a Sep 25 10:38:53 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:53 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355" returned: 0 in 0.525s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:53 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355 Sep 25 10:38:53 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:53 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 1073741824" returned: 0 in 0.621s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:53 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7.89384c46-cd27-4c06-818d-0b277c025e7a" returned: 0 in 0.381s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:53 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0834e2f3-4e30-41ac-8e2d-c9db81504355" returned: 0 in 0.341s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "cinder-quobyte-89384c46-cd27-4c06-818d-0b277c025e7a" released by "_delete_snapshot" :: held 2.128s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Lock "cinder-quobyte-0834e2f3-4e30-41ac-8e2d-c9db81504355" released by "delete_volume" :: held 1.001s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "cinder-quobyte-91271b95-72e9-4aa5-aac1-94a5881f86c7" released by "delete_snapshot" :: held 2.197s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:53 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 Sep 25 10:38:53 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:53 devstack cinder-volume[87242]: WARNING cinder.quota [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Created reservations ['9193f84e-337d-4065-9b7b-1fb180d028ca'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG cinder.quota [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Created reservations ['67325f3b-0c0b-423c-b9cb-0642f8b6aa1e', '3e15207b-ecd2-4bf4-b5c9-183bc8589187', '6eb8f11c-bdc7-4637-bf80-55d82f55c162', 'e174936c-3c9e-4f68-a65c-9cbc49c6668b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:53 devstack cinder-volume[87242]: WARNING cinder.quota [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1227872361 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1227872361, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:38:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Delete snapshot completed successfully. Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Created reservations ['899be82e-dd20-49a9-9ac1-45abe6e4f645', 'af2d5066-d22d-402a-bd85-6996b797709a', '8ba990e3-885e-42fa-ab4c-813fe72fd92b', '6827a40d-1bd1-49a7-a03d-a2514bfe2e08'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-d8beb803-6701-4c7b-adf2-e149edafbf72 req-a3dfb362-eb0f-480d-b47a-2fe8d289d82f tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "cinder-89384c46-cd27-4c06-818d-0b277c025e7a-delete_snapshot" released by "delete_snapshot" :: held 2.504s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:53 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1" returned: 0 in 0.450s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10e5fe1-f01c-4f70-acbe-d41c2ac12dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f669e21-367f-4b32-9459-649120be01b1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5fce83-c06d-47ba-a863-f04328938c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:54 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:54 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:54 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Volume volume-3f669e21-367f-4b32-9459-649120be01b1 (3f669e21-367f-4b32-9459-649120be01b1): created successfully Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5fce83-c06d-47ba-a863-f04328938c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Flow 'volume_create_manager' (d018478b-e2a7-47c8-b2db-4365cbdf0d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:54 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-bfaacfd7-9ff7-447e-92d9-394ac3862bcd tempest-GroupSnapshotsTest-705481147 None] Created volume successfully. Sep 25 10:38:54 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.298s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:54 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-be10da7b-e40b-4e45-a5f5-49ee9557083a tempest-GroupSnapshotsV319Test-142392452 None] Delete group completed successfully. Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Acquiring lock "cinder-91271b95-72e9-4aa5-aac1-94a5881f86c7-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "cinder-91271b95-72e9-4aa5-aac1-94a5881f86c7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Acquiring lock "cinder-quobyte-91271b95-72e9-4aa5-aac1-94a5881f86c7" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "cinder-quobyte-91271b95-72e9-4aa5-aac1-94a5881f86c7" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b4b356-9e8b-40d4-90d3-4a43115890c9]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:55 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 Sep 25 10:38:55 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:55 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7" returned: 0 in 0.554s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:55 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7 Sep 25 10:38:55 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:55 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91271b95-72e9-4aa5-aac1-94a5881f86c7" returned: 0 in 0.384s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:55 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Flow 'volume_create_manager' (9c28b999-9861-45e8-b1e3-6d0e8db411d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10430943-1fd4-4aa4-9293-756292249562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "cinder-quobyte-91271b95-72e9-4aa5-aac1-94a5881f86c7" released by "delete_volume" :: held 1.135s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10430943-1fd4-4aa4-9293-756292249562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-90062616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fb2b4c6-8ed1-48e2-8eea-a03479fbc54b,host='devstack@QuobyteHD#QuobyteHD',id=88c4f974-a536-45f2-afea-63a5cbf0f169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635b019c109458da2d5504446fbf1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:56Z,use_quota=True,user_id='6082b7793ff44f218787de7545da863c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d527b0e7-09b1-4b65-b947-26edb9b34845),volume_type_id=d527b0e7-09b1-4b65-b947-26edb9b34845)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee0c639-e58b-434e-942b-5e252184488b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee0c639-e58b-434e-942b-5e252184488b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f715583-09f1-43ed-b05c-f5744fcc926e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f715583-09f1-43ed-b05c-f5744fcc926e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c4f974-a536-45f2-afea-63a5cbf0f169', 'volume_name': 'volume-88c4f974-a536-45f2-afea-63a5cbf0f169', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715d4ffe-7c71-4830-9b9a-9bbc1a613f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715d4ffe-7c71-4830-9b9a-9bbc1a613f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187e269d-66a0-40dd-aae8-0eed5ca3684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:56 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Volume 88c4f974-a536-45f2-afea-63a5cbf0f169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c4f974-a536-45f2-afea-63a5cbf0f169', 'volume_size': 1} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8fb2b4c6-8ed1-48e2-8eea-a03479fbc54b,created_at=2026-09-25T08:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-90062616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fb2b4c6-8ed1-48e2-8eea-a03479fbc54b,host='devstack@QuobyteHD#QuobyteHD',id=88c4f974-a536-45f2-afea-63a5cbf0f169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635b019c109458da2d5504446fbf1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:56Z,use_quota=True,user_id='6082b7793ff44f218787de7545da863c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d527b0e7-09b1-4b65-b947-26edb9b34845),volume_type_id=d527b0e7-09b1-4b65-b947-26edb9b34845)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Creating volume 88c4f974-a536-45f2-afea-63a5cbf0f169 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:56 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:56 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 1073741824 Sep 25 10:38:56 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.quota [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Created reservations ['7aa61bfe-ed95-43cc-9492-4f93410ca90a', '35491f7f-a33c-483c-b6f2-e561d295d5d3', '57e299e5-cfd4-44dd-b294-d92e24480aeb', 'ef4ce2f7-1c40-4c42-aa95-2195b4abaf7a'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:56 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:38:56 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:56 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.362s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.manager [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:38:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Deleted volume successfully. Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-9ceee800-6c47-4767-8254-4364ed7c8f04 req-df742cef-e9eb-49a8-889f-518377740d29 tempest-VolumesSnapshotsTestJSON-1982703681 None] Lock "cinder-91271b95-72e9-4aa5-aac1-94a5881f86c7-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:38:56 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 1073741824" returned: 0 in 0.646s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:56 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 Sep 25 10:38:56 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:57 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169" returned: 0 in 0.477s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187e269d-66a0-40dd-aae8-0eed5ca3684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c4f974-a536-45f2-afea-63a5cbf0f169', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dbb4c3-28d1-41fd-bac2-b86bc8d5c586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:57 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Volume volume-88c4f974-a536-45f2-afea-63a5cbf0f169 (88c4f974-a536-45f2-afea-63a5cbf0f169): created successfully Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dbb4c3-28d1-41fd-bac2-b86bc8d5c586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Flow 'volume_create_manager' (9c28b999-9861-45e8-b1e3-6d0e8db411d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Flow 'volume_create_manager' (c99b16d9-6f19-4152-8824-266679a5138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd7daba-90d5-47e6-a6dd-66331f24a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:57 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-483f5dff-4ce1-44cc-b97a-427dec27cf56 tempest-GroupSnapshotsTest-705481147 None] Created volume successfully. Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd7daba-90d5-47e6-a6dd-66331f24a017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-317062509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf42936a-f1b4-4780-87af-12e476364b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f74a8389ee4219b80b2676a709fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:57Z,use_quota=True,user_id='c325f46c05634e2ca216fe21fcea6867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f633d861-053c-4dbf-8a79-b370c83fefbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f633d861-053c-4dbf-8a79-b370c83fefbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df35683f-b33d-491a-a50e-1502a71bec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df35683f-b33d-491a-a50e-1502a71bec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf42936a-f1b4-4780-87af-12e476364b99', 'volume_name': 'volume-bf42936a-f1b4-4780-87af-12e476364b99', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8adcd9a-f687-4f91-92c2-d6805f7fcec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8adcd9a-f687-4f91-92c2-d6805f7fcec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8013fb4e-64f8-40f2-82f2-9f67972aebaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:57 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Volume bf42936a-f1b4-4780-87af-12e476364b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf42936a-f1b4-4780-87af-12e476364b99', 'volume_size': 1} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-317062509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf42936a-f1b4-4780-87af-12e476364b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f74a8389ee4219b80b2676a709fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:38:57Z,use_quota=True,user_id='c325f46c05634e2ca216fe21fcea6867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Creating volume bf42936a-f1b4-4780-87af-12e476364b99 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:38:57 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:38:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:57 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99 1073741824 Sep 25 10:38:57 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:58 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99 1073741824" returned: 0 in 0.648s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:58 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99 Sep 25 10:38:58 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:38:58 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Sep 25 10:38:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99" returned: 0 in 0.385s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:38:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:38:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:38:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8013fb4e-64f8-40f2-82f2-9f67972aebaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf42936a-f1b4-4780-87af-12e476364b99', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f611a2c9-c314-41ca-a6be-11e58c5b69ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:38:58 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Volume volume-bf42936a-f1b4-4780-87af-12e476364b99 (bf42936a-f1b4-4780-87af-12e476364b99): created successfully Sep 25 10:38:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f611a2c9-c314-41ca-a6be-11e58c5b69ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:38:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Flow 'volume_create_manager' (c99b16d9-6f19-4152-8824-266679a5138c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:38:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-dc7c87bc-7f59-4e42-ae69-16373ea3e0f5 tempest-VolumesServicesTestJSON-261523809 None] Created volume successfully. Sep 25 10:38:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f1f8c0e9-e713-430f-ad0f-b12f4c89b5a6 tempest-GroupSnapshotsTest-705481147 None] Update group completed successfully. Sep 25 10:38:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Acquiring lock "cinder-bf42936a-f1b4-4780-87af-12e476364b99-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Lock "cinder-bf42936a-f1b4-4780-87af-12e476364b99-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Acquiring lock "cinder-quobyte-bf42936a-f1b4-4780-87af-12e476364b99" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:38:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Lock "cinder-quobyte-bf42936a-f1b4-4780-87af-12e476364b99" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:38:59 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a25639-d50b-4013-ac64-6bb5053d3c7d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:38:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:38:59 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99 Sep 25 10:38:59 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:00 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-53413785-745e-4710-a2a9-46fafa8d1cd6 tempest-GroupSnapshotsTest-705481147 None] Update group completed successfully. Sep 25 10:39:00 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99" returned: 0 in 0.549s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:00 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99 Sep 25 10:39:00 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:00 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bf42936a-f1b4-4780-87af-12e476364b99" returned: 0 in 0.284s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Lock "cinder-quobyte-bf42936a-f1b4-4780-87af-12e476364b99" released by "delete_volume" :: held 0.903s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Created reservations ['d2bc25b4-9657-45ce-9681-79be425e5f40', '290b265a-585c-4295-8b43-0410743de7cf', 'b233b9bd-fd1b-4646-94c4-f72c4ee9f949', '61220996-7051-4bcf-94f2-e82b7bbcd192'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:00 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:39:00 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:01 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.310s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:01 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:01 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Deleted volume successfully. Sep 25 10:39:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a57a844-5c9c-4507-b4e8-29765c1fbe5c tempest-VolumesServicesTestJSON-261523809 None] Lock "cinder-bf42936a-f1b4-4780-87af-12e476364b99-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:01 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e1f5118d-3ea2-4490-a413-a210ba35f9ea tempest-GroupSnapshotsTest-705481147 None] Update group completed successfully. Sep 25 10:39:02 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ad8f8964-6137-4c80-b8a8-7091d95c904c tempest-GroupSnapshotsTest-705481147 None] Update group completed successfully. Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:03 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:39:03 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:03 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.455s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:39:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:39:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] GroupSnapshot 696536de-9df9-4f11-b895-af6ac35dab4a: creating. Sep 25 10:39:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Group snapshot 696536de-9df9-4f11-b895-af6ac35dab4a: creating. {{(pid=87242) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 10:39:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Creating offline snapshot 4cc40384-8256-4b69-92f2-edf55be73dbc of volume 3f669e21-367f-4b32-9459-649120be01b1 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:39:04 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7de44c-3b5d-45cc-ae5d-89e936905335]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:04 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 Sep 25 10:39:04 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:05 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Flow 'volume_create_manager' (a8ee44f7-b364-4b84-8d05-b780fb32654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f10b3f5-00d9-49df-a2a8-f93c0cb462fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1" returned: 0 in 0.841s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f10b3f5-00d9-49df-a2a8-f93c0cb462fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-538284702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cd12a5-73ff-4c6a-aac7-64c31202fb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0401fd11f846c7815162b126d55a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:05Z,use_quota=True,user_id='c435886a9a4140c5a9449e76e0c1e30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:05 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc 1G Sep 25 10:39:05 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c0833c-fc84-4abe-b1f2-10d6e89efc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c0833c-fc84-4abe-b1f2-10d6e89efc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8711b119-a81b-495f-afdd-c433bfc40e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8711b119-a81b-495f-afdd-c433bfc40e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8cd12a5-73ff-4c6a-aac7-64c31202fb9b', 'volume_name': 'volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b9f0c3-12bf-494b-a0b4-aca8fbcbaf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b9f0c3-12bf-494b-a0b4-aca8fbcbaf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e280f55b-186a-40d6-9d3a-df27f68f3362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:05 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b', 'volume_size': 1} Sep 25 10:39:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:06 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc 1G" returned: 0 in 0.644s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f669e21-367f-4b32-9459-649120be01b1 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:06 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f669e21-367f-4b32-9459-649120be01b1 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc Sep 25 10:39:06 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:06 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f669e21-367f-4b32-9459-649120be01b1 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc" returned: 0 in 0.416s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:06 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:39:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:06 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc Sep 25 10:39:06 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:06 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc" returned: 0 in 0.297s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:06 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.info Sep 25 10:39:06 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:07 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.info" returned: 0 in 0.333s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:07 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:07 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.info Sep 25 10:39:07 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:07 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.info" returned: 0 in 0.319s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.988s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Creating offline snapshot e23d192f-9765-4109-bcdf-10643a62f6d0 of volume 88c4f974-a536-45f2-afea-63a5cbf0f169 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b56f3b-4c2e-4d00-b2d9-087390ada3d2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:07 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 Sep 25 10:39:07 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:07 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169" returned: 0 in 0.482s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:08 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 1G Sep 25 10:39:08 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:08 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 1G" returned: 0 in 0.667s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c4f974-a536-45f2-afea-63a5cbf0f169 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:08 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c4f974-a536-45f2-afea-63a5cbf0f169 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 Sep 25 10:39:08 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:09 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c4f974-a536-45f2-afea-63a5cbf0f169 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0" returned: 0 in 0.410s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:09 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:39:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:09 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 Sep 25 10:39:09 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:09 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0" returned: 0 in 0.285s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:09 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.info Sep 25 10:39:09 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:09 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.info" returned: 0 in 0.321s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:09 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:39:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:09 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.info Sep 25 10:39:09 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:10 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.info" returned: 0 in 0.348s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.644s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-538284702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cd12a5-73ff-4c6a-aac7-64c31202fb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0401fd11f846c7815162b126d55a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:05Z,use_quota=True,user_id='c435886a9a4140c5a9449e76e0c1e30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Creating volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:39:10 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:10 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b 1073741824 Sep 25 10:39:10 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:10 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d93f325b-3033-4ff0-9821-5cc093bac415 tempest-GroupSnapshotsTest-705481147 None] group_snapshot 696536de-9df9-4f11-b895-af6ac35dab4a: created successfully Sep 25 10:39:10 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b 1073741824" returned: 0 in 0.588s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:10 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b Sep 25 10:39:10 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:11 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" returned: 0 in 0.335s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e280f55b-186a-40d6-9d3a-df27f68f3362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2032d047-6c97-450e-9ca9-1fadaea11ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] group_snapshot 696536de-9df9-4f11-b895-af6ac35dab4a: deleting Sep 25 10:39:11 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Volume volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b (e8cd12a5-73ff-4c6a-aac7-64c31202fb9b): created successfully Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2032d047-6c97-450e-9ca9-1fadaea11ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Flow 'volume_create_manager' (a8ee44f7-b364-4b84-8d05-b780fb32654d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] group_snapshot 696536de-9df9-4f11-b895-af6ac35dab4a: deleting {{(pid=87242) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 10:39:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-9641044d-7b29-4bdb-9aeb-86e335d88322 tempest-SnapshotsActionsTest-1510715580 None] Created volume successfully. Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-3f669e21-367f-4b32-9459-649120be01b1" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-3f669e21-367f-4b32-9459-649120be01b1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-4cc40384-8256-4b69-92f2-edf55be73dbc" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-4cc40384-8256-4b69-92f2-edf55be73dbc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Deleting offline snapshot 4cc40384-8256-4b69-92f2-edf55be73dbc of volume 3f669e21-367f-4b32-9459-649120be01b1 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] snapshot_file for this snap is: volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[461c5916-65fa-40f7-8a00-81234d7e3878]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:11 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc Sep 25 10:39:11 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:11 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc" returned: 0 in 0.427s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f669e21-367f-4b32-9459-649120be01b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f488c9-ab39-4087-ab2e-80327f8a093a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:11 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 Sep 25 10:39:11 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:12 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1" returned: 0 in 0.632s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:12 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc Sep 25 10:39:12 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Creating offline snapshot a0f636ab-2ede-43d7-9cea-53b579c1578f of volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:39:12 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d8a887-d585-405a-a980-c491956599a4]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:12 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b Sep 25 10:39:12 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:13 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc" returned: 0 in 0.605s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:13 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc Sep 25 10:39:13 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:13 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" returned: 0 in 0.626s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:13 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f 1G Sep 25 10:39:13 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:13 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1.4cc40384-8256-4b69-92f2-edf55be73dbc" returned: 0 in 0.409s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-4cc40384-8256-4b69-92f2-edf55be73dbc" released by "_delete_snapshot" :: held 2.231s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-3f669e21-367f-4b32-9459-649120be01b1" released by "delete_snapshot" :: held 2.265s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-88c4f974-a536-45f2-afea-63a5cbf0f169" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-88c4f974-a536-45f2-afea-63a5cbf0f169" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-e23d192f-9765-4109-bcdf-10643a62f6d0" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-e23d192f-9765-4109-bcdf-10643a62f6d0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Deleting offline snapshot e23d192f-9765-4109-bcdf-10643a62f6d0 of volume 88c4f974-a536-45f2-afea-63a5cbf0f169 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] snapshot_file for this snap is: volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dd26cf-d816-4c8e-9ce3-d25c3e485a5b]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:13 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:13 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 Sep 25 10:39:13 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f 1G" returned: 0 in 0.658s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:13 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:39:13 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:14 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0" returned: 0 in 0.624s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c4f974-a536-45f2-afea-63a5cbf0f169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fff659-1eee-4aa8-a0f3-54233d29ff61]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:14 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.503s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:14 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f is being set with open permissions: ugo+rw Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:14 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:39:14 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:14 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 Sep 25 10:39:14 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:14 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.433s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=165,cinder:SELECT=163,cinder:INSERT=36,cinder:DELETE=12 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:14 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.info Sep 25 10:39:14 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:14 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169" returned: 0 in 0.626s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:15 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 Sep 25 10:39:15 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:15 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.info" returned: 0 in 0.358s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:15 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.info is being set with open permissions: ugo+rw Sep 25 10:39:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:15 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.info Sep 25 10:39:15 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:15 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0" returned: 0 in 0.497s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:15 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0 Sep 25 10:39:15 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:15 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.info" returned: 0 in 0.379s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.133s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:15 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3d385017-23e0-46b9-90d4-e809f547fc51 tempest-SnapshotsActionsTest-1510715580 None] Create snapshot completed successfully Sep 25 10:39:15 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169.e23d192f-9765-4109-bcdf-10643a62f6d0" returned: 0 in 0.341s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-e23d192f-9765-4109-bcdf-10643a62f6d0" released by "_delete_snapshot" :: held 2.277s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-88c4f974-a536-45f2-afea-63a5cbf0f169" released by "delete_snapshot" :: held 2.324s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:15 devstack cinder-volume[87242]: WARNING cinder.quota [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-174724817 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-174724817, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:15 devstack cinder-volume[87242]: WARNING cinder.quota [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-174724817 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-174724817, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:15 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['3fc929d7-b9c0-43f9-935d-18e11dc46911', '61b826cb-b91d-4147-b940-730c5156b111', '4af608f6-104f-47e9-a684-b8f209b8e135', 'f804ed94-1fdb-4533-adcb-68f39a1f45a4'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:16 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=158,cinder:UPDATE=175,cinder:DELETE=7,cinder:INSERT=42 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:39:16 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['de53cbe1-25ac-4b65-8232-31b476c8f944', '5edbf15a-32ab-4448-a734-e33fbe09b2a5', 'e442dcc4-223b-4175-b07a-dae8c575dc27', '63ec5319-a475-4b19-bdf2-f999dc165504'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2a9cc939-5eb4-4834-a099-d7968ae00c03 tempest-GroupSnapshotsTest-705481147 None] group_snapshot 696536de-9df9-4f11-b895-af6ac35dab4a: deleted successfully Sep 25 10:39:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-3f669e21-367f-4b32-9459-649120be01b1" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-3f669e21-367f-4b32-9459-649120be01b1" acquired by "delete_volume" :: waited 0.051s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:17 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7626eb-4103-42b5-a048-6326ca9c0253]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] Creating offline snapshot 0bf7265f-6aa4-4307-b476-be548dfe0779 of volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:39:17 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 Sep 25 10:39:17 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:17 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f2ff25-018a-40c8-8dfc-1841932227ec]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:17 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:39:17 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:18 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1" returned: 0 in 0.538s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:18 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1 Sep 25 10:39:18 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:18 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.597s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:18 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 1G Sep 25 10:39:18 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:18 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3f669e21-367f-4b32-9459-649120be01b1" returned: 0 in 0.464s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-3f669e21-367f-4b32-9459-649120be01b1" released by "delete_volume" :: held 1.115s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-88c4f974-a536-45f2-afea-63a5cbf0f169" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-88c4f974-a536-45f2-afea-63a5cbf0f169" acquired by "delete_volume" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ade9524-8b1c-45c9-8063-d41891babeac]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:18 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 Sep 25 10:39:18 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:19 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 1G" returned: 0 in 0.662s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:19 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 Sep 25 10:39:19 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:19 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169" returned: 0 in 0.574s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:19 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169 Sep 25 10:39:19 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:19 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779" returned: 0 in 0.414s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:19 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 is being set with open permissions: ugo+rw Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:19 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 Sep 25 10:39:19 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:19 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-88c4f974-a536-45f2-afea-63a5cbf0f169" returned: 0 in 0.319s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-88c4f974-a536-45f2-afea-63a5cbf0f169" released by "delete_volume" :: held 0.984s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['d65e5f14-60b4-4f51-a6ae-01bbed89f36b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:19 devstack cinder-volume[87242]: WARNING cinder.quota [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-174724817 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-174724817, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:19 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779" returned: 0 in 0.362s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:19 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['58b6fc6d-1994-491a-b220-719ee61723ba', 'fb53d337-7b63-41cd-b9b7-1bbeb5802cc6', '857e5d7d-5d96-4d32-8b4f-b2bd684990d9', '7399112c-80ef-4316-b405-e390be51951b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:19 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-dc58ef34-3296-4e2d-8877-4f2302b5e703 tempest-SnapshotsActionsTest-1510715580 None] Create snapshot completed successfully Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['d81e5d3e-c735-4f85-ba40-e22605eb4b20', 'e13522f1-09a7-4035-8bd9-f681462385cf', '1feab7cf-217d-49c6-97d3-339513fe384f', 'f1db3447-91d3-4a86-8c00-94aecfe034ec'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:20 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:39:20 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Flow 'volume_create_manager' (5992ce95-6356-412d-9428-d3123697941f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813beda5-57c7-4d27-8452-261e90e362bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813beda5-57c7-4d27-8452-261e90e362bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1855356610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4e38b1c3144a40801cc58d7b969656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:21Z,use_quota=True,user_id='7cdf3ccfdcde4a9cbee562db68bcf6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26150f5e-b3bf-4af3-b090-9fccf5122d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26150f5e-b3bf-4af3-b090-9fccf5122d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80f48c3-5006-428f-b134-700d424209a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80f48c3-5006-428f-b134-700d424209a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba', 'volume_name': 'volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25234834-6ab4-44ab-9637-1bad41c5c751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25234834-6ab4-44ab-9637-1bad41c5c751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab77e8e-0766-4161-997d-b8e71f7563d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:20 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Volume c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba', 'volume_size': 1} Sep 25 10:39:20 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1855356610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4e38b1c3144a40801cc58d7b969656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:21Z,use_quota=True,user_id='7cdf3ccfdcde4a9cbee562db68bcf6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Creating volume c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:39:20 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.575s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-96ec1193-3c54-4a36-be18-bb8677291c84 tempest-GroupSnapshotsTest-705481147 None] Delete group completed successfully. Sep 25 10:39:20 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba 1073741824 Sep 25 10:39:20 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-0bf7265f-6aa4-4307-b476-be548dfe0779-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-0bf7265f-6aa4-4307-b476-be548dfe0779-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-quobyte-0bf7265f-6aa4-4307-b476-be548dfe0779" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-0bf7265f-6aa4-4307-b476-be548dfe0779" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Deleting offline snapshot 0bf7265f-6aa4-4307-b476-be548dfe0779 of volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] snapshot_file for this snap is: volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[800f6a4b-b77f-4353-ad74-665587dbe021]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:21 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 Sep 25 10:39:21 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:21 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779" returned: 0 in 0.571s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:21 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba 1073741824" returned: 0 in 0.809s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7958fdb-f373-4c14-aeff-e8270797a55a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:21 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba Sep 25 10:39:21 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:21 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:39:21 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7ce997eb-709f-4935-85c6-e9c379aed8da tempest-GroupSnapshotsTest-705481147 None] Group tempest-GroupSnapshotsTest-Group-1108936416: creating Sep 25 10:39:22 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" returned: 0 in 0.384s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7ce997eb-709f-4935-85c6-e9c379aed8da tempest-GroupSnapshotsTest-705481147 None] Group tempest-GroupSnapshotsTest-Group-1108936416: created successfully Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab77e8e-0766-4161-997d-b8e71f7563d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57f8676-88ac-4140-9189-bf51445f3ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7ce997eb-709f-4935-85c6-e9c379aed8da tempest-GroupSnapshotsTest-705481147 None] Create group completed successfully. Sep 25 10:39:22 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Volume volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba (c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba): created successfully Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57f8676-88ac-4140-9189-bf51445f3ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Flow 'volume_create_manager' (5992ce95-6356-412d-9428-d3123697941f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8bde3ed0-7ac0-4d70-93fd-b59f44a715e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Created volume successfully. Sep 25 10:39:22 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.566s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:22 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 Sep 25 10:39:22 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:22 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779" returned: 0 in 0.509s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:22 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779 Sep 25 10:39:22 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-de5d883f-bebd-4033-958e-f11f8368e48c tempest-GroupsV314Test-1984865148 None] Group tempest-GroupsV314Test-Group-649077917: creating Sep 25 10:39:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-de5d883f-bebd-4033-958e-f11f8368e48c tempest-GroupsV314Test-1984865148 None] Group tempest-GroupsV314Test-Group-649077917: created successfully Sep 25 10:39:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-de5d883f-bebd-4033-958e-f11f8368e48c tempest-GroupsV314Test-1984865148 None] Create group completed successfully. Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Creating offline snapshot 8c3766c0-7688-405b-a4cf-05625e18398e of volume c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:39:23 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.0bf7265f-6aa4-4307-b476-be548dfe0779" returned: 0 in 0.364s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3a2bec-9b10-4e97-a746-631a7a1e420a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-0bf7265f-6aa4-4307-b476-be548dfe0779" released by "_delete_snapshot" :: held 2.174s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" released by "delete_snapshot" :: held 2.206s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Created reservations ['e902c28a-6f67-49ed-bfe4-c61e17e7b275', '9f7815c5-c03c-4480-92f0-2834dd5dba02', '5c3900d4-4145-4e9e-8961-9615ef67f285', 'cb7370f1-feed-4d62-963d-5c461bb93587'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:23 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba Sep 25 10:39:23 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Delete snapshot completed successfully. Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eb5c922a-6f66-4e0f-819c-64894e5d3d32 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-0bf7265f-6aa4-4307-b476-be548dfe0779-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:23 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" returned: 0 in 0.458s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:23 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e 1G Sep 25 10:39:23 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Flow 'volume_create_manager' (749c0590-d7c8-42bb-9d52-431756c027d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3a38e5-8f3d-4eed-9326-319e6d5773c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3a38e5-8f3d-4eed-9326-319e6d5773c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-657150573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5f6f3c0-2ac0-4b8f-9bdf-b9c7451f2ccc,host='devstack@QuobyteHD#QuobyteHD',id=86258032-3f48-4f6e-a7a8-36bbed4d4cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635b019c109458da2d5504446fbf1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:24Z,use_quota=True,user_id='6082b7793ff44f218787de7545da863c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01d91a0b-0774-4e57-9660-70050b1fe86c),volume_type_id=01d91a0b-0774-4e57-9660-70050b1fe86c)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf71103-a665-4875-b647-978bcc9a7f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf71103-a665-4875-b647-978bcc9a7f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45fe3d4-728d-4950-9d8d-c16ac4b03ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45fe3d4-728d-4950-9d8d-c16ac4b03ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86258032-3f48-4f6e-a7a8-36bbed4d4cdb', 'volume_name': 'volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603e407a-b3c8-45a6-8a40-75b7d8328ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603e407a-b3c8-45a6-8a40-75b7d8328ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688541cd-a27d-44d8-bc3e-20a57f3ff5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:23 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Volume 86258032-3f48-4f6e-a7a8-36bbed4d4cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb', 'volume_size': 1} Sep 25 10:39:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:24 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e 1G" returned: 0 in 0.501s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:24 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e Sep 25 10:39:24 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:24 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e" returned: 0 in 0.372s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:24 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e is being set with open permissions: ugo+rw Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:24 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e Sep 25 10:39:24 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:24 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e" returned: 0 in 0.321s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:39:24 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.info Sep 25 10:39:24 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Flow 'volume_create_manager' (4a2088ce-29ed-44dc-88f6-dc622cb9fdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336682e3-bca4-476e-8e54-cc35a5dc2977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336682e3-bca4-476e-8e54-cc35a5dc2977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-585488996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98e54b1d-5b2b-4c40-9e9c-2a674b1a9b4f,host='devstack@QuobyteHD#QuobyteHD',id=2dc140ab-58d6-4d39-b972-c1c4cef32bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df45730e1764b13b067bd59ea6688dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:25Z,use_quota=True,user_id='ba0ef2b4d1364b5faad8c21b7625adc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f51753b2-bd54-4c1e-9a8f-1fb5ddb5ec0c),volume_type_id=f51753b2-bd54-4c1e-9a8f-1fb5ddb5ec0c)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb10adf5-2691-4f39-96e1-efbbd72800fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb10adf5-2691-4f39-96e1-efbbd72800fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca9f979-9a72-4a69-a4e7-eadb2526fa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca9f979-9a72-4a69-a4e7-eadb2526fa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc140ab-58d6-4d39-b972-c1c4cef32bea', 'volume_name': 'volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2b9e96-a016-4fa6-92ad-11551f627d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2b9e96-a016-4fa6-92ad-11551f627d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82983dc-4e04-4e78-84cf-d3adbe33c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:25 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Volume 2dc140ab-58d6-4d39-b972-c1c4cef32bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea', 'volume_size': 1} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:25 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.info" returned: 0 in 0.344s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:25 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.info is being set with open permissions: ugo+rw Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:25 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.info Sep 25 10:39:25 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:25 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.info" returned: 0 in 0.279s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.666s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b5f6f3c0-2ac0-4b8f-9bdf-b9c7451f2ccc,created_at=2026-09-25T08:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-657150573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5f6f3c0-2ac0-4b8f-9bdf-b9c7451f2ccc,host='devstack@QuobyteHD#QuobyteHD',id=86258032-3f48-4f6e-a7a8-36bbed4d4cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635b019c109458da2d5504446fbf1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:24Z,use_quota=True,user_id='6082b7793ff44f218787de7545da863c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01d91a0b-0774-4e57-9660-70050b1fe86c),volume_type_id=01d91a0b-0774-4e57-9660-70050b1fe86c)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Creating volume 86258032-3f48-4f6e-a7a8-36bbed4d4cdb {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:39:25 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:39:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:25 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb 1073741824 Sep 25 10:39:25 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:25 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6636e099-5d48-4cb2-b3e4-180dbc954ad8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Create snapshot completed successfully Sep 25 10:39:26 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb 1073741824" returned: 0 in 0.537s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:26 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb Sep 25 10:39:26 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:26 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" returned: 0 in 0.296s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.561s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688541cd-a27d-44d8-bc3e-20a57f3ff5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6af2d5c-fa9e-489d-bc3d-acd187df3f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] Creating offline snapshot 5c012d02-dd2e-4292-a1f0-f4f05e90c126 of volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:39:26 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Volume volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb (86258032-3f48-4f6e-a7a8-36bbed4d4cdb): created successfully Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6af2d5c-fa9e-489d-bc3d-acd187df3f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Flow 'volume_create_manager' (749c0590-d7c8-42bb-9d52-431756c027d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbef950-236e-4314-b850-e8190290ab71]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:26 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-12080961-17f9-4c2f-b57d-761e7cc23d7d tempest-GroupSnapshotsTest-705481147 None] Created volume successfully. Sep 25 10:39:26 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:39:26 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Acquiring lock "cinder-8c3766c0-7688-405b-a4cf-05625e18398e-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "cinder-8c3766c0-7688-405b-a4cf-05625e18398e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Acquiring lock "cinder-quobyte-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "cinder-quobyte-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Acquiring lock "cinder-quobyte-8c3766c0-7688-405b-a4cf-05625e18398e" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "cinder-quobyte-8c3766c0-7688-405b-a4cf-05625e18398e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Deleting offline snapshot 8c3766c0-7688-405b-a4cf-05625e18398e of volume c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] snapshot_file for this snap is: volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[86698179-470e-4b1b-9179-962fb366c62b]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:27 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.440s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:27 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 1G Sep 25 10:39:27 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:27 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e Sep 25 10:39:27 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:27 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e" returned: 0 in 0.417s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f1cbb9-985e-4bac-ac03-a8d331f92520]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:27 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba Sep 25 10:39:27 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:27 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 1G" returned: 0 in 0.558s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:27 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 Sep 25 10:39:27 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:27 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] GroupSnapshot cece1e97-842d-4450-9418-916500d80a04: creating. Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Group snapshot cece1e97-842d-4450-9418-916500d80a04: creating. {{(pid=87242) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:27 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" returned: 0 in 0.479s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:27 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e Sep 25 10:39:27 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:27 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126" returned: 0 in 0.396s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:27 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 is being set with open permissions: ugo+rw Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:28 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 Sep 25 10:39:28 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:28 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126" returned: 0 in 0.287s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:28 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.316s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=98e54b1d-5b2b-4c40-9e9c-2a674b1a9b4f,created_at=2026-09-25T08:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-585488996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98e54b1d-5b2b-4c40-9e9c-2a674b1a9b4f,host='devstack@QuobyteHD#QuobyteHD',id=2dc140ab-58d6-4d39-b972-c1c4cef32bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df45730e1764b13b067bd59ea6688dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:25Z,use_quota=True,user_id='ba0ef2b4d1364b5faad8c21b7625adc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f51753b2-bd54-4c1e-9a8f-1fb5ddb5ec0c),volume_type_id=f51753b2-bd54-4c1e-9a8f-1fb5ddb5ec0c)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Creating volume 2dc140ab-58d6-4d39-b972-c1c4cef32bea {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:39:28 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e" returned: 0 in 0.473s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:28 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea 1073741824 Sep 25 10:39:28 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:28 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e Sep 25 10:39:28 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:28 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8dedcd20-2a68-4a9a-bb8a-81dc2aaa2a0c tempest-SnapshotsActionsTest-1510715580 None] Create snapshot completed successfully Sep 25 10:39:28 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba.8c3766c0-7688-405b-a4cf-05625e18398e" returned: 0 in 0.298s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "cinder-quobyte-8c3766c0-7688-405b-a4cf-05625e18398e" released by "_delete_snapshot" :: held 1.810s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "cinder-quobyte-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" released by "delete_snapshot" :: held 1.837s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Created reservations ['d4ff4723-888a-401b-9d7f-a048efab41c7', 'b3c09ddd-45d6-4a9a-867e-6f5f35078851', '89e74e40-c901-4eb1-870f-74f30cde22d7', '073941b3-4164-4313-a761-a34c1e56c234'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:28 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Delete snapshot completed successfully. Sep 25 10:39:28 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9ae1426-38aa-4ec4-b816-d38391bc0aa9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "cinder-8c3766c0-7688-405b-a4cf-05625e18398e-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea 1073741824" returned: 0 in 0.560s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:28 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea Sep 25 10:39:28 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-5c012d02-dd2e-4292-a1f0-f4f05e90c126-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-5c012d02-dd2e-4292-a1f0-f4f05e90c126-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-quobyte-5c012d02-dd2e-4292-a1f0-f4f05e90c126" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-5c012d02-dd2e-4292-a1f0-f4f05e90c126" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Deleting offline snapshot 5c012d02-dd2e-4292-a1f0-f4f05e90c126 of volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] snapshot_file for this snap is: volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Acquiring lock "cinder-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e54cda-cbb5-4d5a-8708-3af211d630fb]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "cinder-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Acquiring lock "cinder-quobyte-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "cinder-quobyte-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" acquired by "delete_volume" :: waited 0.017s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:29 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea" returned: 0 in 0.317s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.405s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d4a778-057d-461b-940d-e6c64ade0e25]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:29 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:29 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82983dc-4e04-4e78-84cf-d3adbe33c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f31cbe-d2bf-4526-b2d4-432049bf218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Creating offline snapshot f147d523-1823-420e-8a27-3b0e09fd5361 of volume 86258032-3f48-4f6e-a7a8-36bbed4d4cdb {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:39:29 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Volume volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea (2dc140ab-58d6-4d39-b972-c1c4cef32bea): created successfully Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f31cbe-d2bf-4526-b2d4-432049bf218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Flow 'volume_create_manager' (4a2088ce-29ed-44dc-88f6-dc622cb9fdb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0452d7-0b58-4edd-8f0d-3b6c6f7ee6cd]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:29 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-65c2dfd9-8c42-42b8-bf4d-da0e1197d304 tempest-GroupsV314Test-1984865148 None] Created volume successfully. Sep 25 10:39:29 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba Sep 25 10:39:29 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:29 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb Sep 25 10:39:29 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:29 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126" returned: 0 in 0.470s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0c9495-bdc4-4d90-ba96-dd85ef04af72]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:29 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" returned: 0 in 0.482s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:29 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba Sep 25 10:39:29 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:29 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:39:29 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:29 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" returned: 0 in 0.567s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:29 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 1G Sep 25 10:39:29 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:30 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" returned: 0 in 0.340s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "cinder-quobyte-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba" released by "delete_volume" :: held 0.913s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:30 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.516s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:30 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 Sep 25 10:39:30 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Created reservations ['73356ba2-942f-46d6-875b-b5e1e93025f0', '46129067-606a-44fd-8660-27ce0a431a16', '8f09f7f3-b4ff-4a15-bb63-62f6aeac0143', 'dc7a8a08-27f2-4b8f-a7e8-ae963870c8a2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:30 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:39:30 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:30 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 1G" returned: 0 in 0.617s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:30 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 Sep 25 10:39:30 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:30 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126" returned: 0 in 0.520s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:30 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.341s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Deleted volume successfully. Sep 25 10:39:30 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126 Sep 25 10:39:30 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48d770be-2ecb-49fb-81c6-4f0e02396ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1638980644 None] Lock "cinder-c2c18c8b-fe92-4ca2-af73-7ed0ec25d8ba-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:30 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361" returned: 0 in 0.364s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:30 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:39:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:30 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 Sep 25 10:39:30 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:31 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.5c012d02-dd2e-4292-a1f0-f4f05e90c126" returned: 0 in 0.336s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-5c012d02-dd2e-4292-a1f0-f4f05e90c126" released by "_delete_snapshot" :: held 2.009s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" released by "delete_snapshot" :: held 2.048s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Created reservations ['9c4d5ec7-5022-4b57-814f-bba9e73740ef', 'e698ed97-f9f2-4559-a3b1-32b81d474ad5', '41431e8c-b596-402a-970f-80c3b4d34bbe', '407f326a-98d6-46ad-b756-97543e07c6c1'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:31 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Delete snapshot completed successfully. Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5fda943a-c0ca-4c51-96df-f2ed414825e0 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-5c012d02-dd2e-4292-a1f0-f4f05e90c126-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:31 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361" returned: 0 in 0.351s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:31 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.info Sep 25 10:39:31 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:31 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.info" returned: 0 in 0.315s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:31 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:31 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.info Sep 25 10:39:31 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:31 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.info" returned: 0 in 0.323s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.693s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.526s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:31 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Cloning volume 2dc140ab-58d6-4d39-b972-c1c4cef32bea to volume 17713087-6661-4cc4-9f6f-0d6f9d082797 Sep 25 10:39:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Creating offline snapshot 7b45143b-72ba-41e7-8928-20e22093d646 of volume 2dc140ab-58d6-4d39-b972-c1c4cef32bea {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:39:32 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e161e2-a7e4-4ed8-b12c-0ab9b65f57f2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:32 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e7f64f40-67f6-4a96-99b5-35c75091e492 tempest-GroupSnapshotsTest-705481147 None] group_snapshot cece1e97-842d-4450-9418-916500d80a04: created successfully Sep 25 10:39:32 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea Sep 25 10:39:32 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:32 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea" returned: 0 in 0.534s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:32 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 1G Sep 25 10:39:32 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:33 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 1G" returned: 0 in 0.653s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:33 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 Sep 25 10:39:33 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:33 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] group_snapshot cece1e97-842d-4450-9418-916500d80a04: deleting Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] group_snapshot cece1e97-842d-4450-9418-916500d80a04: deleting {{(pid=87242) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-f147d523-1823-420e-8a27-3b0e09fd5361" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-f147d523-1823-420e-8a27-3b0e09fd5361" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Deleting offline snapshot f147d523-1823-420e-8a27-3b0e09fd5361 of volume 86258032-3f48-4f6e-a7a8-36bbed4d4cdb {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] snapshot_file for this snap is: volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3112e53-6df1-49cc-abc7-2919c975586b]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:33 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646" returned: 0 in 0.535s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:33 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:39:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:33 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 Sep 25 10:39:33 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:33 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 Sep 25 10:39:33 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:34 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646" returned: 0 in 0.302s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:34 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.info Sep 25 10:39:34 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:34 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361" returned: 0 in 0.515s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98d81f2-5590-4ba6-b0a7-fddb0f054b5f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:34 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb Sep 25 10:39:34 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:34 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.info" returned: 0 in 0.330s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:34 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:34 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.info Sep 25 10:39:34 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:34 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" returned: 0 in 0.447s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:34 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 Sep 25 10:39:34 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:34 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.info" returned: 0 in 0.314s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Acquiring lock "cinder-quobyte-17713087-6661-4cc4-9f6f-0d6f9d082797" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Lock "cinder-quobyte-17713087-6661-4cc4-9f6f-0d6f9d082797" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] snapshot: 7b45143b-72ba-41e7-8928-20e22093d646, volume: 17713087-6661-4cc4-9f6f-0d6f9d082797, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4572259-625d-460e-b34d-eb09250e2a97]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:35 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 Sep 25 10:39:35 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:35 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361" returned: 0 in 0.425s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:35 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361 Sep 25 10:39:35 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:35 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646" returned: 0 in 0.478s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b3e1f1-9482-4500-b000-59c9306b15ed]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:35 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb.f147d523-1823-420e-8a27-3b0e09fd5361" returned: 0 in 0.346s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-f147d523-1823-420e-8a27-3b0e09fd5361" released by "_delete_snapshot" :: held 1.890s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" released by "delete_snapshot" :: held 1.928s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:35 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea Sep 25 10:39:35 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:35 devstack cinder-volume[87242]: WARNING cinder.quota [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-235251252 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-235251252, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:35 devstack cinder-volume[87242]: WARNING cinder.quota [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-235251252 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-235251252, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['a24404d7-5c1c-43b7-9f24-2f69df8ff188', '9d105660-c401-429d-a4cf-475845094cc1', 'd4cd8636-f276-4a1e-85d9-bf7d85221348', '96d8271b-d2a2-434b-a3f7-d33607b860d2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-fb1d6562-f749-49ca-9dcf-af82fffe8be1 tempest-GroupSnapshotsTest-705481147 None] group_snapshot cece1e97-842d-4450-9418-916500d80a04: deleted successfully Sep 25 10:39:35 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea" returned: 0 in 0.491s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:39:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:35 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 Sep 25 10:39:35 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "cinder-quobyte-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:36 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75ba614-3691-4a2c-aab8-a1f0120e2008]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:36 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb Sep 25 10:39:36 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:37 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" returned: 0 in 0.803s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:37 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb Sep 25 10:39:37 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:37 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" returned: 0 in 0.584s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Lock "cinder-quobyte-86258032-3f48-4f6e-a7a8-36bbed4d4cdb" released by "delete_volume" :: held 1.522s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:38 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['8b5c90d8-0f59-49d3-b459-40a91dbc4d49'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:38 devstack cinder-volume[87242]: WARNING cinder.quota [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-235251252 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-235251252, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:38 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Created reservations ['25b8b18b-b174-48d7-ae5e-e20e82d6a94d', 'd830c630-620a-48f4-a9e8-579c74f043c7', 'b72cec17-fdf7-41b5-96a6-ac761ac8d4c6', '99cefbfb-1a51-493d-bca5-5c488a7772f6'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:38 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:39:38 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:39 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.725s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:39 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:39 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-254f9874-acc3-4caa-8f81-8c332b416cf5 tempest-GroupSnapshotsTest-705481147 None] Delete group completed successfully. Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Flow 'volume_create_manager' (54db4368-7bb2-45f4-a64d-aa9e3566baad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fb0ee0-d6d9-44b2-808d-37ee2425e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fb0ee0-d6d9-44b2-808d-37ee2425e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1402468016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de48a53-7ab3-41d8-bc7b-5621c14e2e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b185e60ac3e948db94fbc78ac5cc6fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:44Z,use_quota=True,user_id='8a69f81823b54fb3a953367b1e862c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1c8c739-dd4c-463b-aea1-663a102a5150),volume_type_id=a1c8c739-dd4c-463b-aea1-663a102a5150)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78cbbed-569d-472a-93a5-225109c03479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78cbbed-569d-472a-93a5-225109c03479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a11fbbc-3cc4-471c-9258-323ffef92dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a11fbbc-3cc4-471c-9258-323ffef92dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de48a53-7ab3-41d8-bc7b-5621c14e2e0b', 'volume_name': 'volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1464e867-a3eb-4cbc-b613-561eabd37785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1464e867-a3eb-4cbc-b613-561eabd37785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c51a78-b879-4968-aeb7-8ca5380cbfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:43 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Volume 4de48a53-7ab3-41d8-bc7b-5621c14e2e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b', 'volume_size': 1} Sep 25 10:39:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:45 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797" returned: 0 in 9.138s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea, size 1024.00 MB, duration 9.14 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:39:45 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Converted 1024.00 MB image at 112.04 MB/s Sep 25 10:39:45 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:45 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 Sep 25 10:39:45 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:45 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797" returned: 0 in 0.327s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Lock "cinder-quobyte-17713087-6661-4cc4-9f6f-0d6f9d082797" released by "_copy_volume_from_snapshot" :: held 10.567s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Acquiring lock "cinder-quobyte-7b45143b-72ba-41e7-8928-20e22093d646" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Lock "cinder-quobyte-7b45143b-72ba-41e7-8928-20e22093d646" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Deleting offline snapshot 7b45143b-72ba-41e7-8928-20e22093d646 of volume 2dc140ab-58d6-4d39-b972-c1c4cef32bea {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] snapshot_file for this snap is: volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a5e52c-eb5e-44c3-ae2b-e31148144466]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:45 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 Sep 25 10:39:45 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:45 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646" returned: 0 in 0.438s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd1dd6a-b9c1-44ec-b1f1-d6243d97cb4d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:46 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea Sep 25 10:39:46 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:46 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea" returned: 0 in 0.587s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:46 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 Sep 25 10:39:46 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:46 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646" returned: 0 in 0.413s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:47 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646 Sep 25 10:39:47 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:47 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea.7b45143b-72ba-41e7-8928-20e22093d646" returned: 0 in 0.300s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:47 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Lock "cinder-quobyte-7b45143b-72ba-41e7-8928-20e22093d646" released by "_delete_snapshot" :: held 1.876s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.363s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.615s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] Creating offline snapshot 798cb27f-ba08-41d8-bfd2-aca0a7664032 of volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:39:47 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[576ba866-404e-43f9-a71b-3999e80f4161]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:47 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d0ac7009-d916-4d93-bd97-3df1abc4a1ae tempest-GroupsV314Test-1984865148 None] Create group from source-group-98e54b1d-5b2b-4c40-9e9c-2a674b1a9b4f completed successfully. Sep 25 10:39:47 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:39:47 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:47 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.459s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:47 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 1G Sep 25 10:39:47 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:48 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 1G" returned: 0 in 0.581s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:48 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 Sep 25 10:39:48 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:48 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:48 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 is being set with open permissions: ugo+rw Sep 25 10:39:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:48 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 Sep 25 10:39:48 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:49 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-68758026-ca48-4fd0-b7a3-bc38c9e52b2f tempest-GroupsV320Test-933105967 None] Group tempest-GroupsV320Test-Group-602767338: creating Sep 25 10:39:49 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-68758026-ca48-4fd0-b7a3-bc38c9e52b2f tempest-GroupsV320Test-933105967 None] Group tempest-GroupsV320Test-Group-602767338: created successfully Sep 25 10:39:49 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032" returned: 0 in 0.314s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:49 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-68758026-ca48-4fd0-b7a3-bc38c9e52b2f tempest-GroupsV320Test-933105967 None] Create group completed successfully. Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.370s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1402468016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de48a53-7ab3-41d8-bc7b-5621c14e2e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b185e60ac3e948db94fbc78ac5cc6fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:39:44Z,use_quota=True,user_id='8a69f81823b54fb3a953367b1e862c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1c8c739-dd4c-463b-aea1-663a102a5150),volume_type_id=a1c8c739-dd4c-463b-aea1-663a102a5150)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Creating volume 4de48a53-7ab3-41d8-bc7b-5621c14e2e0b {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:39:49 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:49 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b 1073741824 Sep 25 10:39:49 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:49 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-272b2315-e3c6-4203-a0f2-eb24d4b74541 tempest-SnapshotsActionsTest-1510715580 None] Create snapshot completed successfully Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Acquiring lock "cinder-quobyte-17713087-6661-4cc4-9f6f-0d6f9d082797" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Lock "cinder-quobyte-17713087-6661-4cc4-9f6f-0d6f9d082797" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[66081c52-4a61-4e8b-ba09-e9afaf47c48d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:49 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 Sep 25 10:39:49 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:49 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b 1073741824" returned: 0 in 0.531s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:49 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797" returned: 0 in 0.466s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:49 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b Sep 25 10:39:49 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:49 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797 Sep 25 10:39:49 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:50 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b" returned: 0 in 0.300s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:50 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c51a78-b879-4968-aeb7-8ca5380cbfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3bf361-e169-4f1e-b5d9-c9aaddd981be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17713087-6661-4cc4-9f6f-0d6f9d082797" returned: 0 in 0.327s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:50 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Volume volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b (4de48a53-7ab3-41d8-bc7b-5621c14e2e0b): created successfully Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3bf361-e169-4f1e-b5d9-c9aaddd981be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Flow 'volume_create_manager' (54db4368-7bb2-45f4-a64d-aa9e3566baad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Lock "cinder-quobyte-17713087-6661-4cc4-9f6f-0d6f9d082797" released by "delete_volume" :: held 0.890s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b0b949e9-8418-4a3c-adb2-65735b6e5fc0 tempest-VolumeTypesAccessTest-2124512380 None] Created volume successfully. Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-798cb27f-ba08-41d8-bfd2-aca0a7664032-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-798cb27f-ba08-41d8-bfd2-aca0a7664032-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Created reservations ['bb50d4ab-6cc1-41e4-8ebf-60ee6993ffa0'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-quobyte-798cb27f-ba08-41d8-bfd2-aca0a7664032" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-798cb27f-ba08-41d8-bfd2-aca0a7664032" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Deleting offline snapshot 798cb27f-ba08-41d8-bfd2-aca0a7664032 of volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] snapshot_file for this snap is: volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:39:50 devstack cinder-volume[87242]: WARNING cinder.quota [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1678718897 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1678718897, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:50 devstack cinder-volume[87242]: WARNING cinder.quota [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1678718897 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1678718897, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[620d9386-dc7c-4cd6-8a7e-03f81c56ba98]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Created reservations ['38288c67-383e-4e1e-a8ba-cac5bb6fe007', '5635f5a5-2d53-438f-a2c1-075adfad75e0', '51ded988-3ffc-4fd1-8b9e-952b882cc9b6', '2b7c0cbf-abdb-4193-b3e3-e5c44a995866'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:50 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 Sep 25 10:39:50 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:50 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:39:50 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:50 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032" returned: 0 in 0.466s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fa0dfc-9370-478b-8ec8-d204b7931cfe]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:50 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.364s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0ea531ae-f7de-4d6c-8cc2-d890edc51c12 tempest-GroupsV314Test-1984865148 None] Delete group completed successfully. Sep 25 10:39:50 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-554a86e7-48a3-43e0-aa49-542e58ca6e1b tempest-GroupsV320Test-933105967 None] Created reservations ['dcd21cf0-b1e5-4767-b3f2-38529d5f6fa9'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-554a86e7-48a3-43e0-aa49-542e58ca6e1b tempest-GroupsV320Test-933105967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-554a86e7-48a3-43e0-aa49-542e58ca6e1b tempest-GroupsV320Test-933105967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-554a86e7-48a3-43e0-aa49-542e58ca6e1b tempest-GroupsV320Test-933105967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-554a86e7-48a3-43e0-aa49-542e58ca6e1b tempest-GroupsV320Test-933105967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-554a86e7-48a3-43e0-aa49-542e58ca6e1b tempest-GroupsV320Test-933105967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554a86e7-48a3-43e0-aa49-542e58ca6e1b tempest-GroupsV320Test-933105967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:51 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:39:51 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:51 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:39:51 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:51 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554a86e7-48a3-43e0-aa49-542e58ca6e1b tempest-GroupsV320Test-933105967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.278s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-554a86e7-48a3-43e0-aa49-542e58ca6e1b tempest-GroupsV320Test-933105967 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:51 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-554a86e7-48a3-43e0-aa49-542e58ca6e1b tempest-GroupsV320Test-933105967 None] Delete group completed successfully. Sep 25 10:39:51 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.442s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:51 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 Sep 25 10:39:51 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Acquiring lock "cinder-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Lock "cinder-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Acquiring lock "cinder-quobyte-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Lock "cinder-quobyte-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c4ad7d-8fdd-464b-94cd-51c54bf56d6d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:51 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b Sep 25 10:39:51 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:51 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Acquiring lock "cinder-quobyte-2dc140ab-58d6-4d39-b972-c1c4cef32bea" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032" returned: 0 in 0.559s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Lock "cinder-quobyte-2dc140ab-58d6-4d39-b972-c1c4cef32bea" acquired by "delete_volume" :: waited 0.039s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:51 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032 Sep 25 10:39:51 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f106b736-1de9-4046-941f-f0d54df54c4e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:52 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b" returned: 0 in 0.564s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:52 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b Sep 25 10:39:52 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:52 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea Sep 25 10:39:52 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:52 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.798cb27f-ba08-41d8-bfd2-aca0a7664032" returned: 0 in 0.376s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-798cb27f-ba08-41d8-bfd2-aca0a7664032" released by "_delete_snapshot" :: held 1.987s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" released by "delete_snapshot" :: held 2.018s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Created reservations ['6c5fff13-ff07-4de1-a73f-ae0b82754a62', '8c62e412-6696-4374-b570-fe667727f096', 'abb4018b-5be4-4ae6-820c-b9f0e17adb28', '346fa3b4-fdba-4de1-9e79-5fb9c08b2035'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:52 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b" returned: 0 in 0.373s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Lock "cinder-quobyte-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b" released by "delete_volume" :: held 1.013s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:52 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Delete snapshot completed successfully. Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c6eb0b8b-31b5-4dba-a8a2-2b409f23a032 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-798cb27f-ba08-41d8-bfd2-aca0a7664032-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:52 devstack cinder-volume[87242]: WARNING cinder.quota [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1976207195 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1976207195, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:52 devstack cinder-volume[87242]: WARNING cinder.quota [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1976207195 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1976207195, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Created reservations ['1c4287f7-9a2a-4493-a865-a046f9757e99', '5f644d3a-31cf-48d5-9499-a81d7f1e754e', 'e59748fb-e70b-41bd-8047-72cb11c873b0', 'b5a7074e-86de-4e46-8dab-c4f627e82762'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:52 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea" returned: 0 in 0.611s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:52 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea Sep 25 10:39:52 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:52 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:39:52 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:53 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2dc140ab-58d6-4d39-b972-c1c4cef32bea" returned: 0 in 0.368s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Lock "cinder-quobyte-2dc140ab-58d6-4d39-b972-c1c4cef32bea" released by "delete_volume" :: held 1.081s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:53 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.367s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Created reservations ['95bf3eab-53e8-4c28-bcb4-82787185d4c1'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Deleted volume successfully. Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c4f126f0-dcf9-4412-a72b-0e1089c8a5c9 tempest-VolumeTypesAccessTest-2124512380 None] Lock "cinder-4de48a53-7ab3-41d8-bc7b-5621c14e2e0b-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Created reservations ['a4c1a14a-005f-4874-ad37-446d1ca59708', '02120e35-1c0b-41be-9cda-70414c6cc036', '91ac9131-887a-4d0c-9c05-4f3171b81084', '8c9a29eb-e0de-4654-8450-cc95761c10c3'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:53 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:39:53 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:53 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.300s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:53 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:39:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0502f642-cfe9-467f-b011-bea85af2a116 tempest-GroupsV314Test-1984865148 None] Delete group completed successfully. Sep 25 10:39:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:39:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:39:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] Creating offline snapshot ddb33ecd-c12f-407e-840f-9a84b2042a9b of volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:39:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e11ee-d203-435f-b2c4-df45be90e6e6]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:54 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:39:54 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:54 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.682s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:54 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b 1G Sep 25 10:39:54 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:55 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b 1G" returned: 0 in 0.693s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:55 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b Sep 25 10:39:55 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:55 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b" returned: 0 in 0.455s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:55 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b is being set with open permissions: ugo+rw Sep 25 10:39:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:56 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b Sep 25 10:39:56 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:56 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b" returned: 0 in 0.348s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:39:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-36d341cc-c7c0-49c1-957c-1f30a848f243 tempest-SnapshotsActionsTest-1510715580 None] Create snapshot completed successfully Sep 25 10:39:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-ddb33ecd-c12f-407e-840f-9a84b2042a9b-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-ddb33ecd-c12f-407e-840f-9a84b2042a9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Acquiring lock "cinder-quobyte-ddb33ecd-c12f-407e-840f-9a84b2042a9b" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:39:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-ddb33ecd-c12f-407e-840f-9a84b2042a9b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:39:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Deleting offline snapshot ddb33ecd-c12f-407e-840f-9a84b2042a9b of volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:39:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] snapshot_file for this snap is: volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:39:57 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb200a2-020d-491c-a2ad-856fdbfe2f7d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:57 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b Sep 25 10:39:57 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:58 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b" returned: 0 in 0.593s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:58 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f92558-95a1-4949-bfdb-f6ec8fde9e6e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:39:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:58 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:39:58 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:58 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.692s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:39:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:58 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b Sep 25 10:39:58 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:59 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b" returned: 0 in 0.586s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:39:59 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b Sep 25 10:39:59 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:39:59 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Sep 25 10:39:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.ddb33ecd-c12f-407e-840f-9a84b2042a9b" returned: 0 in 0.356s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:39:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-ddb33ecd-c12f-407e-840f-9a84b2042a9b" released by "_delete_snapshot" :: held 2.433s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:39:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" released by "delete_snapshot" :: held 2.469s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:00 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Created reservations ['0430cb83-0672-403f-b49c-24bab1ee3e60', 'f468b9cb-20fc-41fe-8087-94e68566616a', 'e2fba897-5fb6-4f5a-9e24-d227b583d421', '5d6817ba-b392-4fe1-a1c8-ef5e602a0849'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:00 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Delete snapshot completed successfully. Sep 25 10:40:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-644e294b-bba4-45a0-8fdd-352ac73e1204 tempest-SnapshotsActionsTest-1542483194 None] Lock "cinder-ddb33ecd-c12f-407e-840f-9a84b2042a9b-delete_snapshot" released by "delete_snapshot" :: held 2.687s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "cinder-a0f636ab-2ede-43d7-9cea-53b579c1578f-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Lock "cinder-a0f636ab-2ede-43d7-9cea-53b579c1578f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "cinder-quobyte-a0f636ab-2ede-43d7-9cea-53b579c1578f" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Lock "cinder-quobyte-a0f636ab-2ede-43d7-9cea-53b579c1578f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Deleting offline snapshot a0f636ab-2ede-43d7-9cea-53b579c1578f of volume e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] snapshot_file for this snap is: volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33e80f3-58e5-4e20-b267-2cdb4e96609c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:01 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:40:01 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:01 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.524s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad68b864-112e-4697-8d75-da9e68df4cb5]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:02 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b Sep 25 10:40:02 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:02 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" returned: 0 in 0.572s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:02 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:40:02 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:03 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.665s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:03 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f Sep 25 10:40:03 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:03 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:40:03 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:03 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b.a0f636ab-2ede-43d7-9cea-53b579c1578f" returned: 0 in 0.309s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Lock "cinder-quobyte-a0f636ab-2ede-43d7-9cea-53b579c1578f" released by "_delete_snapshot" :: held 2.258s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" released by "delete_snapshot" :: held 2.295s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Created reservations ['12977bb2-151c-4339-a6e4-30cb950e8e78', '92f1f2be-7b1d-4494-85c3-e30cfb61427d', 'f9de222b-2bab-40a1-ad61-916f81b4cc8a', '8d441c02-f5f6-471b-9236-5f250742d895'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:03 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Delete snapshot completed successfully. Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1886f028-0276-4ee6-85ad-07d8f2d9e7e7 tempest-SnapshotsActionsTest-1510715580 None] Lock "cinder-a0f636ab-2ede-43d7-9cea-53b579c1578f-delete_snapshot" released by "delete_snapshot" :: held 2.591s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:03 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.456s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:40:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:40:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "cinder-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Lock "cinder-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" acquired by "delete_volume" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:04 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4585ca81-7c1b-4dfd-ac0b-4df896c19786]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:04 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b Sep 25 10:40:04 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:05 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" returned: 0 in 0.515s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:05 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b Sep 25 10:40:05 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:05 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Lock "cinder-quobyte-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b" released by "delete_volume" :: held 0.982s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Created reservations ['4334dd8e-38cd-4ef0-8e63-36bf588a52c2', '0816a057-9ca7-42be-b1d1-fd1dc7117cc0', '59728f1d-c2e3-48b3-8bea-e32036c2e17b', '07e9f7b8-2624-4633-a603-d921e23d33c4'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:06 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:40:06 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Flow 'volume_create_manager' (edfd6ab0-8e09-48a5-a481-7d7edf9ee7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f621a85f-54a6-4a12-9c59-84f45c8aecfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f621a85f-54a6-4a12-9c59-84f45c8aecfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1266355034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ea5934-767d-44a5-b3c5-c1083b4a0769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce8184fa8374957aea15cb5a304c569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:06Z,use_quota=True,user_id='43c1d608f2ab4024be25f8cc8dea5888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00551e0-eb01-4dd3-86fb-5c12e7d4e361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00551e0-eb01-4dd3-86fb-5c12e7d4e361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5780ea0-8d05-42ce-9b7c-30b76c0212af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5780ea0-8d05-42ce-9b7c-30b76c0212af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ea5934-767d-44a5-b3c5-c1083b4a0769', 'volume_name': 'volume-54ea5934-767d-44a5-b3c5-c1083b4a0769', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63d2028-c403-44d3-ab53-1b88fe2f1d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63d2028-c403-44d3-ab53-1b88fe2f1d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133cea16-2948-4afc-9d0b-17b8d4a2dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:06 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Volume 54ea5934-767d-44a5-b3c5-c1083b4a0769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ea5934-767d-44a5-b3c5-c1083b4a0769', 'volume_size': 1} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1266355034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ea5934-767d-44a5-b3c5-c1083b4a0769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce8184fa8374957aea15cb5a304c569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:06Z,use_quota=True,user_id='43c1d608f2ab4024be25f8cc8dea5888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Creating volume 54ea5934-767d-44a5-b3c5-c1083b4a0769 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:40:06 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:06 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769 1073741824 Sep 25 10:40:06 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:06 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.406s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:40:06 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Deleted volume successfully. Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-106dc41d-334c-40f2-b573-74dc99141346 tempest-SnapshotsActionsTest-1510715580 None] Lock "cinder-e8cd12a5-73ff-4c6a-aac7-64c31202fb9b-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:06 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769 1073741824" returned: 0 in 0.612s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:06 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769 Sep 25 10:40:06 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:07 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769" returned: 0 in 0.396s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:40:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133cea16-2948-4afc-9d0b-17b8d4a2dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ea5934-767d-44a5-b3c5-c1083b4a0769', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ca13f4-833a-4401-b561-5cbb464c1a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:07 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Volume volume-54ea5934-767d-44a5-b3c5-c1083b4a0769 (54ea5934-767d-44a5-b3c5-c1083b4a0769): created successfully Sep 25 10:40:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ca13f4-833a-4401-b561-5cbb464c1a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Flow 'volume_create_manager' (edfd6ab0-8e09-48a5-a481-7d7edf9ee7c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4e08201b-a2e3-43b8-b988-5ea0b30ba186 tempest-VolumesListAdminTestJSON-1685680644 None] Created volume successfully. Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Flow 'volume_create_manager' (99fad75c-6ec0-4a64-8666-30baecde576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0562a2e-e1df-4cca-9ac9-4246fbfafbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0562a2e-e1df-4cca-9ac9-4246fbfafbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1129546613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6738db5b-c8eb-48ba-8775-7858a02d686a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce8184fa8374957aea15cb5a304c569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:09Z,use_quota=True,user_id='43c1d608f2ab4024be25f8cc8dea5888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ea4b5b-9174-4539-81cc-a8095b324e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ea4b5b-9174-4539-81cc-a8095b324e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce98222-0991-4407-8e88-5b1f9c4c5ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce98222-0991-4407-8e88-5b1f9c4c5ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6738db5b-c8eb-48ba-8775-7858a02d686a', 'volume_name': 'volume-6738db5b-c8eb-48ba-8775-7858a02d686a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a238b73f-a8d7-480f-a0d8-a2a55f30d8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a238b73f-a8d7-480f-a0d8-a2a55f30d8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a88db121-f291-4581-b879-31df8a74c19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:09 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Volume 6738db5b-c8eb-48ba-8775-7858a02d686a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6738db5b-c8eb-48ba-8775-7858a02d686a', 'volume_size': 1} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1129546613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6738db5b-c8eb-48ba-8775-7858a02d686a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce8184fa8374957aea15cb5a304c569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:09Z,use_quota=True,user_id='43c1d608f2ab4024be25f8cc8dea5888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Creating volume 6738db5b-c8eb-48ba-8775-7858a02d686a {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:40:09 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:09 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a 1073741824 Sep 25 10:40:09 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:09 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a 1073741824" returned: 0 in 0.780s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:10 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a Sep 25 10:40:10 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:10 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a" returned: 0 in 0.381s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:40:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a88db121-f291-4581-b879-31df8a74c19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6738db5b-c8eb-48ba-8775-7858a02d686a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c240069a-6b59-42e4-86dd-7950f394b016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:10 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Volume volume-6738db5b-c8eb-48ba-8775-7858a02d686a (6738db5b-c8eb-48ba-8775-7858a02d686a): created successfully Sep 25 10:40:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c240069a-6b59-42e4-86dd-7950f394b016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Flow 'volume_create_manager' (99fad75c-6ec0-4a64-8666-30baecde576d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:10 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0c695981-59a1-4df4-bf93-2f517a13afc2 tempest-VolumesListAdminTestJSON-1685680644 None] Created volume successfully. Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Flow 'volume_create_manager' (37fbd67e-0297-430c-b745-f9a848748a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e24a4d-aa5c-474d-84a2-f87617088e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e24a4d-aa5c-474d-84a2-f87617088e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1489040892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57ecf9b-694f-407f-aa1a-fa7237574010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce8184fa8374957aea15cb5a304c569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:12Z,use_quota=True,user_id='43c1d608f2ab4024be25f8cc8dea5888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abccee4f-0f56-4768-bdcb-c6d33d8b1e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abccee4f-0f56-4768-bdcb-c6d33d8b1e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01293928-22db-420d-b705-87c8b0add77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01293928-22db-420d-b705-87c8b0add77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e57ecf9b-694f-407f-aa1a-fa7237574010', 'volume_name': 'volume-e57ecf9b-694f-407f-aa1a-fa7237574010', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63ba544-ebe6-4bdf-bb24-5acaa0a0fa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63ba544-ebe6-4bdf-bb24-5acaa0a0fa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7368105a-1b76-4958-9886-521297ff65cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:11 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Volume e57ecf9b-694f-407f-aa1a-fa7237574010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e57ecf9b-694f-407f-aa1a-fa7237574010', 'volume_size': 1} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1489040892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57ecf9b-694f-407f-aa1a-fa7237574010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce8184fa8374957aea15cb5a304c569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:12Z,use_quota=True,user_id='43c1d608f2ab4024be25f8cc8dea5888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Creating volume e57ecf9b-694f-407f-aa1a-fa7237574010 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:40:11 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:40:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:11 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010 1073741824 Sep 25 10:40:11 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:12 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010 1073741824" returned: 0 in 0.652s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:12 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010 Sep 25 10:40:12 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:12 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010" returned: 0 in 0.397s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:40:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7368105a-1b76-4958-9886-521297ff65cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57ecf9b-694f-407f-aa1a-fa7237574010', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747ba91d-0c2c-4288-81fc-68d08a90ca19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:13 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Volume volume-e57ecf9b-694f-407f-aa1a-fa7237574010 (e57ecf9b-694f-407f-aa1a-fa7237574010): created successfully Sep 25 10:40:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747ba91d-0c2c-4288-81fc-68d08a90ca19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Flow 'volume_create_manager' (37fbd67e-0297-430c-b745-f9a848748a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:13 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7fa559e0-a1bc-402e-b40b-adaaf69951da tempest-VolumesListAdminTestJSON-1685680644 None] Created volume successfully. Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Flow 'volume_create_manager' (e953b55c-8b7f-4f46-a7b8-28bf7919a634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e5ff50-7a1c-4cd2-8ebb-9422bdfceb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e5ff50-7a1c-4cd2-8ebb-9422bdfceb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-356104621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83e730a-5909-4def-adb2-6c930a8cb555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e436b95e7cfa447ab4b818ac3b7721bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:15Z,use_quota=True,user_id='93936b65435845f39ccb1a0a8489d7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0189ff57-ee89-46ac-8632-3530677c1a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0189ff57-ee89-46ac-8632-3530677c1a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b8c5de-908e-4060-8c08-37cca90c2b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b8c5de-908e-4060-8c08-37cca90c2b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83e730a-5909-4def-adb2-6c930a8cb555', 'volume_name': 'volume-b83e730a-5909-4def-adb2-6c930a8cb555', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ae295b-36ad-48d3-83e4-0e3991a62776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ae295b-36ad-48d3-83e4-0e3991a62776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68264d4-d6f4-4e05-99a4-66529529be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:14 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Volume b83e730a-5909-4def-adb2-6c930a8cb555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83e730a-5909-4def-adb2-6c930a8cb555', 'volume_size': 1} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-356104621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83e730a-5909-4def-adb2-6c930a8cb555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e436b95e7cfa447ab4b818ac3b7721bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:15Z,use_quota=True,user_id='93936b65435845f39ccb1a0a8489d7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Creating volume b83e730a-5909-4def-adb2-6c930a8cb555 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:40:14 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:40:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:14 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555 1073741824 Sep 25 10:40:14 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=148,cinder:DELETE=10,cinder:UPDATE=167,cinder:INSERT=36 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Flow 'volume_create_manager' (9dc49702-9a83-4bea-bc33-3d232df11655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35af1b8-6551-49f5-b203-2060dc10b806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35af1b8-6551-49f5-b203-2060dc10b806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a72b7b-abb8-48c2-8ee0-733a93e542cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddbba0c92a0480db3d2b906af540974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:15Z,use_quota=True,user_id='1f18825758bf41eba00d841a12b4fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eaf416e-34fe-4342-b3e9-48c0b7bc64e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eaf416e-34fe-4342-b3e9-48c0b7bc64e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d25b0f-5274-4e83-965f-c02636a3e42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d25b0f-5274-4e83-965f-c02636a3e42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a72b7b-abb8-48c2-8ee0-733a93e542cf', 'volume_name': 'volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:15 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bc123f-00ed-4a6a-b35a-d392221aff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bc123f-00ed-4a6a-b35a-d392221aff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8af512a-5345-4d32-8d4c-d5a55fea87d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:15 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Volume 41a72b7b-abb8-48c2-8ee0-733a93e542cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf', 'volume_size': 1} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555 1073741824" returned: 0 in 0.669s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:15 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555 Sep 25 10:40:15 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:15 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555" returned: 0 in 0.305s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a72b7b-abb8-48c2-8ee0-733a93e542cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddbba0c92a0480db3d2b906af540974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:15Z,use_quota=True,user_id='1f18825758bf41eba00d841a12b4fbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Creating volume 41a72b7b-abb8-48c2-8ee0-733a93e542cf {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:40:15 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:15 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf 1073741824 Sep 25 10:40:15 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68264d4-d6f4-4e05-99a4-66529529be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83e730a-5909-4def-adb2-6c930a8cb555', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c779cfc1-f4b0-42cb-81ce-2ef479ede701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:15 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Volume volume-b83e730a-5909-4def-adb2-6c930a8cb555 (b83e730a-5909-4def-adb2-6c930a8cb555): created successfully Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c779cfc1-f4b0-42cb-81ce-2ef479ede701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Flow 'volume_create_manager' (e953b55c-8b7f-4f46-a7b8-28bf7919a634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:15 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f4d50651-22f6-43b8-9ee3-728efce5cebb tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Created volume successfully. Sep 25 10:40:16 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf 1073741824" returned: 0 in 0.562s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:16 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=151,cinder:INSERT=46,cinder:UPDATE=162,cinder:DELETE=7 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:40:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:16 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf Sep 25 10:40:16 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:16 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf" returned: 0 in 0.340s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:40:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8af512a-5345-4d32-8d4c-d5a55fea87d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce89aa9-7ccb-4501-8cdd-0ba629e88657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:16 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Volume volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf (41a72b7b-abb8-48c2-8ee0-733a93e542cf): created successfully Sep 25 10:40:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce89aa9-7ccb-4501-8cdd-0ba629e88657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Flow 'volume_create_manager' (9dc49702-9a83-4bea-bc33-3d232df11655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-50c9fb5f-021d-4280-a365-8cf309924590 tempest-VolumesListAdminTestJSON-727795640 None] Created volume successfully. Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Acquiring lock "cinder-41a72b7b-abb8-48c2-8ee0-733a93e542cf-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Lock "cinder-41a72b7b-abb8-48c2-8ee0-733a93e542cf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Acquiring lock "cinder-quobyte-41a72b7b-abb8-48c2-8ee0-733a93e542cf" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Lock "cinder-quobyte-41a72b7b-abb8-48c2-8ee0-733a93e542cf" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[87470518-e6be-45b6-bc31-1821a76cbf12]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "cinder-e57ecf9b-694f-407f-aa1a-fa7237574010-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-e57ecf9b-694f-407f-aa1a-fa7237574010-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:17 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf Sep 25 10:40:17 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "cinder-quobyte-e57ecf9b-694f-407f-aa1a-fa7237574010" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-quobyte-e57ecf9b-694f-407f-aa1a-fa7237574010" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fbb2cb-1eeb-411b-bf02-553318640f66]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:18 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010 Sep 25 10:40:18 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:18 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf" returned: 0 in 0.600s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:18 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf Sep 25 10:40:18 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Acquiring lock "cinder-b83e730a-5909-4def-adb2-6c930a8cb555-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:18 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010" returned: 0 in 0.601s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Lock "cinder-b83e730a-5909-4def-adb2-6c930a8cb555-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:18 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010 Sep 25 10:40:18 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Acquiring lock "cinder-quobyte-b83e730a-5909-4def-adb2-6c930a8cb555" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Lock "cinder-quobyte-b83e730a-5909-4def-adb2-6c930a8cb555" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1348cd-8ce3-4ae2-8bb0-17bb9c7ef6a8]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:18 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41a72b7b-abb8-48c2-8ee0-733a93e542cf" returned: 0 in 0.448s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Lock "cinder-quobyte-41a72b7b-abb8-48c2-8ee0-733a93e542cf" released by "delete_volume" :: held 1.117s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Created reservations ['823b4f54-1ef4-45ed-84c8-95814e9fe616', 'f3018138-eb28-408c-ade1-aaa9fa5a64cb', 'ed685e9d-aa6f-4072-9bac-04cdc6cd285a', 'fca55834-9839-4a3b-8c3e-ce4b810cd684'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:18 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555 Sep 25 10:40:18 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:18 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e57ecf9b-694f-407f-aa1a-fa7237574010" returned: 0 in 0.514s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:18 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:40:18 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-quobyte-e57ecf9b-694f-407f-aa1a-fa7237574010" released by "delete_volume" :: held 1.201s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Created reservations ['2658ecd6-9730-47b5-a234-9bd948976b0a', 'd7dbd230-503d-4e18-a3f4-495f57c93efe', '32d2e08f-3120-4f32-8516-d771f92c448c', '870ec851-ca26-480f-9ad4-8dac13a24b48'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:19 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:40:19 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:19 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.426s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:40:19 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Deleted volume successfully. Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fbc77a23-0e1b-4db5-ba38-700408fca7e6 tempest-VolumesListAdminTestJSON-727795640 None] Lock "cinder-41a72b7b-abb8-48c2-8ee0-733a93e542cf-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:19 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555" returned: 0 in 0.852s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:19 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555 Sep 25 10:40:19 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:19 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.499s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:40:19 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Deleted volume successfully. Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bc278e23-0911-4026-bb2e-3ac7e40135ed tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-e57ecf9b-694f-407f-aa1a-fa7237574010-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:19 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b83e730a-5909-4def-adb2-6c930a8cb555" returned: 0 in 0.403s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Lock "cinder-quobyte-b83e730a-5909-4def-adb2-6c930a8cb555" released by "delete_volume" :: held 1.349s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Created reservations ['c019891b-110b-413c-8852-aa56f345e3fe', 'bf491302-072a-4e21-86d8-12034b39e3f4', '5b23b362-1d2c-4b78-90c8-41913f73a882', '44e4a464-ada0-4345-af75-2e5271a646bc'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:20 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:40:20 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "cinder-6738db5b-c8eb-48ba-8775-7858a02d686a-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-6738db5b-c8eb-48ba-8775-7858a02d686a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "cinder-quobyte-6738db5b-c8eb-48ba-8775-7858a02d686a" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-quobyte-6738db5b-c8eb-48ba-8775-7858a02d686a" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca942e3-62f7-40cc-bf1d-7bac34719fee]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:20 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a Sep 25 10:40:20 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:20 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.357s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:40:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Deleted volume successfully. Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bf27826-b510-4041-8902-3adf787ce6d7 tempest-VolumeQuotasNegativeTestJSON-2089939577 None] Lock "cinder-b83e730a-5909-4def-adb2-6c930a8cb555-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:20 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a" returned: 0 in 0.466s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:20 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a Sep 25 10:40:20 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:21 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6738db5b-c8eb-48ba-8775-7858a02d686a" returned: 0 in 0.372s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-quobyte-6738db5b-c8eb-48ba-8775-7858a02d686a" released by "delete_volume" :: held 0.903s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Created reservations ['1166be24-c3f9-4152-b8ec-bba23af80a3c', 'f3aca1e9-2454-4010-aee3-58d0bc7a0a07', '33a8906f-4ca6-4532-a799-849bec0d13a8', '92c01791-5530-441e-a9b4-ec71271e5859'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:21 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:40:21 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:21 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.362s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:40:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Deleted volume successfully. Sep 25 10:40:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1fe4f93-a9da-4798-aaf8-23ad33b5e797 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-6738db5b-c8eb-48ba-8775-7858a02d686a-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "cinder-54ea5934-767d-44a5-b3c5-c1083b4a0769-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-54ea5934-767d-44a5-b3c5-c1083b4a0769-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "cinder-quobyte-54ea5934-767d-44a5-b3c5-c1083b4a0769" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-quobyte-54ea5934-767d-44a5-b3c5-c1083b4a0769" acquired by "delete_volume" :: waited 0.043s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:22 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[198f7daa-7ca9-4bd7-921b-c63068d3fd58]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:23 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769 Sep 25 10:40:23 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:23 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769" returned: 0 in 0.484s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:23 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769 Sep 25 10:40:23 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:23 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-54ea5934-767d-44a5-b3c5-c1083b4a0769" returned: 0 in 0.368s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-quobyte-54ea5934-767d-44a5-b3c5-c1083b4a0769" released by "delete_volume" :: held 0.962s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:23 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Created reservations ['0da992c3-7009-4e4f-9172-2454955c3f24', '488cb544-8c4f-4893-b055-f6ed99bb8821', 'ed65f916-58db-4bdd-9a88-55f031a6e2a5', 'b93e074e-7603-4c17-838c-5a77495acb06'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:24 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:40:24 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:24 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.501s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:24 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:40:24 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Deleted volume successfully. Sep 25 10:40:24 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1d664f2b-49e4-4043-b9c5-5565b2e4f9c4 tempest-VolumesListAdminTestJSON-1685680644 None] Lock "cinder-54ea5934-767d-44a5-b3c5-c1083b4a0769-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:33 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=42,cinder:SELECT=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:40:34 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=26,cinder:UPDATE=46,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Flow 'volume_create_manager' (03fe6c4f-b3af-4a04-a608-1d32444fe8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9686cf61-c0de-4a89-9575-d699d2324378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9686cf61-c0de-4a89-9575-d699d2324378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-245488113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ea43f3-47f1-4002-b7a4-6dc5de67fcae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1ad924d92f4037ae4656571b3ced4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:37Z,use_quota=True,user_id='65dbe8c90ec94ee6a1b41e5a257d5db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c3e674-0cc8-4e1e-a046-dad9314d0022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c3e674-0cc8-4e1e-a046-dad9314d0022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eca29dd-0a90-4c81-b883-ed7ab0d592ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eca29dd-0a90-4c81-b883-ed7ab0d592ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ea43f3-47f1-4002-b7a4-6dc5de67fcae', 'volume_name': 'volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a919946-9983-4f9e-bc28-39599af7415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a919946-9983-4f9e-bc28-39599af7415d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b990eb-f5cb-4cc9-954e-5a0d29734a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:37 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Volume c5ea43f3-47f1-4002-b7a4-6dc5de67fcae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae', 'volume_size': 1} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-245488113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ea43f3-47f1-4002-b7a4-6dc5de67fcae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1ad924d92f4037ae4656571b3ced4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:37Z,use_quota=True,user_id='65dbe8c90ec94ee6a1b41e5a257d5db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Creating volume c5ea43f3-47f1-4002-b7a4-6dc5de67fcae {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:40:37 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:40:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:37 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae 1073741824 Sep 25 10:40:37 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:38 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae 1073741824" returned: 0 in 0.814s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:38 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae Sep 25 10:40:38 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:38 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" returned: 0 in 0.490s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:40:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b990eb-f5cb-4cc9-954e-5a0d29734a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985edd71-7242-49ba-89a9-66aa9cac132f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:39 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Volume volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae (c5ea43f3-47f1-4002-b7a4-6dc5de67fcae): created successfully Sep 25 10:40:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985edd71-7242-49ba-89a9-66aa9cac132f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Flow 'volume_create_manager' (03fe6c4f-b3af-4a04-a608-1d32444fe8a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:39 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4919cad0-1a65-4b13-8fd0-b0e0b2bb9c0a tempest-SnapshotMetadataTestJSON-378247306 None] Created volume successfully. Sep 25 10:40:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Creating offline snapshot 72b67bce-9133-4413-9832-c4a8404ea668 of volume c5ea43f3-47f1-4002-b7a4-6dc5de67fcae {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:40:40 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc270b14-a7d2-4ab8-be0a-67a804bb2740]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:40 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae Sep 25 10:40:40 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:40 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" returned: 0 in 0.616s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:40 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 1G Sep 25 10:40:40 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:41 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 1G" returned: 0 in 0.782s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:41 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 Sep 25 10:40:41 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:42 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668" returned: 0 in 0.639s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:42 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 is being set with open permissions: ugo+rw Sep 25 10:40:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:42 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 Sep 25 10:40:42 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:42 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668" returned: 0 in 0.501s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:42 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.info Sep 25 10:40:42 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:43 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.info" returned: 0 in 0.485s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:43 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.info is being set with open permissions: ugo+rw Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:43 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.info Sep 25 10:40:43 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:40:43 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Flow 'volume_create_manager' (4551a008-3d55-4127-8be6-f4b8867ef0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cc9e7e-0e6f-41f8-912d-ec097eb5786f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.info" returned: 0 in 0.451s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.656s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cc9e7e-0e6f-41f8-912d-ec097eb5786f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-531809445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36c9a0d-3234-4b76-8b81-cf25ccb7a890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d05bdce8c6f4fa49f24f51bb53f9c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:44Z,use_quota=True,user_id='d66254ef1e9d4a0aadbe92455e96858f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34764c5-0f75-413b-9fb9-605bbf9d54f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34764c5-0f75-413b-9fb9-605bbf9d54f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872b0c65-bed9-43e2-814b-75028e40ce0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872b0c65-bed9-43e2-814b-75028e40ce0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36c9a0d-3234-4b76-8b81-cf25ccb7a890', 'volume_name': 'volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de454fc1-e505-4b3f-8c4c-708e052ca1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de454fc1-e505-4b3f-8c4c-708e052ca1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec81a0e3-38ca-4e09-bd42-d12d60184b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:43 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Volume f36c9a0d-3234-4b76-8b81-cf25ccb7a890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890', 'volume_size': 1} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-531809445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36c9a0d-3234-4b76-8b81-cf25ccb7a890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d05bdce8c6f4fa49f24f51bb53f9c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:40:44Z,use_quota=True,user_id='d66254ef1e9d4a0aadbe92455e96858f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Creating volume f36c9a0d-3234-4b76-8b81-cf25ccb7a890 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:40:43 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:40:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:43 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-14fa165c-570a-4f6d-820a-f6c5238faf0a tempest-SnapshotMetadataTestJSON-378247306 None] Create snapshot completed successfully Sep 25 10:40:43 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890 1073741824 Sep 25 10:40:43 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:44 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890 1073741824" returned: 0 in 0.675s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:44 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890 Sep 25 10:40:44 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:44 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890" returned: 0 in 0.414s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:40:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec81a0e3-38ca-4e09-bd42-d12d60184b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f09b0f2-e555-43e3-ac96-3218be37a8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:45 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Volume volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890 (f36c9a0d-3234-4b76-8b81-cf25ccb7a890): created successfully Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f09b0f2-e555-43e3-ac96-3218be37a8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Flow 'volume_create_manager' (4551a008-3d55-4127-8be6-f4b8867ef0f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:45 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-93417442-b0ca-4de6-85db-d12ecf18d808 tempest-AbsoluteLimitsTests-748741481 None] Created volume successfully. Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Acquiring lock "cinder-72b67bce-9133-4413-9832-c4a8404ea668-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "cinder-72b67bce-9133-4413-9832-c4a8404ea668-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Acquiring lock "cinder-quobyte-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "cinder-quobyte-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Acquiring lock "cinder-quobyte-72b67bce-9133-4413-9832-c4a8404ea668" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "cinder-quobyte-72b67bce-9133-4413-9832-c4a8404ea668" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Deleting offline snapshot 72b67bce-9133-4413-9832-c4a8404ea668 of volume c5ea43f3-47f1-4002-b7a4-6dc5de67fcae {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] snapshot_file for this snap is: volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2f8ae7-591c-4aae-8ca3-b997c3a4e053]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:46 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 Sep 25 10:40:46 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Acquiring lock "cinder-f36c9a0d-3234-4b76-8b81-cf25ccb7a890-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Lock "cinder-f36c9a0d-3234-4b76-8b81-cf25ccb7a890-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Acquiring lock "cinder-quobyte-f36c9a0d-3234-4b76-8b81-cf25ccb7a890" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Lock "cinder-quobyte-f36c9a0d-3234-4b76-8b81-cf25ccb7a890" acquired by "delete_volume" :: waited 0.015s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:46 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ae6492-3e3c-4281-b005-017a846492e4]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:46 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668" returned: 0 in 0.712s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:40:46 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890 Sep 25 10:40:46 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:46 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9838477e-5d7c-4d11-b24e-9ba68521f551]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:46 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae Sep 25 10:40:46 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:47 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890" returned: 0 in 0.516s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:47 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890 Sep 25 10:40:47 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:47 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" returned: 0 in 0.539s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:47 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 Sep 25 10:40:47 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:47 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f36c9a0d-3234-4b76-8b81-cf25ccb7a890" returned: 0 in 0.343s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Lock "cinder-quobyte-f36c9a0d-3234-4b76-8b81-cf25ccb7a890" released by "delete_volume" :: held 0.940s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Created reservations ['d221ffb0-a71a-40c6-afb8-d2f07021b6d5', 'd0c87613-028b-4b49-9713-6fd05364e9df', 'bd9f9b3d-cfd4-4a19-addf-73b70446f80f', '727e2793-9554-4c59-a48b-873c02196e47'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:47 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:40:47 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:47 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668" returned: 0 in 0.544s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:47 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668 Sep 25 10:40:47 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:48 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.409s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:48 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:40:48 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Deleted volume successfully. Sep 25 10:40:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66acf0b8-95a9-4076-b756-7fb5c6a18a2d tempest-AbsoluteLimitsTests-748741481 None] Lock "cinder-f36c9a0d-3234-4b76-8b81-cf25ccb7a890-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:48 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae.72b67bce-9133-4413-9832-c4a8404ea668" returned: 0 in 0.382s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "cinder-quobyte-72b67bce-9133-4413-9832-c4a8404ea668" released by "_delete_snapshot" :: held 2.395s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "cinder-quobyte-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" released by "delete_snapshot" :: held 2.458s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:48 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Created reservations ['cdff484b-aac8-434a-8c07-373ee1b96082', '325bbdb3-31dc-484e-a987-e4b6341836ff', 'a62db147-017a-4f44-bb20-1c35ee23a590', 'da4ef704-f0bb-47e3-aa87-1e38a1fe1fea'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:48 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Delete snapshot completed successfully. Sep 25 10:40:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5cb96db1-4319-4131-b065-4a16ae90a479 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "cinder-72b67bce-9133-4413-9832-c4a8404ea668-delete_snapshot" released by "delete_snapshot" :: held 2.713s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Acquiring lock "cinder-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "cinder-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Acquiring lock "cinder-quobyte-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:40:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "cinder-quobyte-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" acquired by "delete_volume" :: waited 0.046s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:40:49 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d8f09e-1232-4eb5-82eb-b7ce1d9dd625]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:40:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:49 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae Sep 25 10:40:49 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:50 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" returned: 0 in 0.721s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:50 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae Sep 25 10:40:50 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:50 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" returned: 0 in 0.357s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "cinder-quobyte-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae" released by "delete_volume" :: held 1.273s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Created reservations ['38c02b89-677e-4c11-9991-7ada9f830e94', '442c526c-b1c9-4831-969d-d0898cfd4051', '0838efc9-587c-4980-9360-c39d0801d1a2', 'a41df1ef-30cd-49f3-805d-c4c5e28806ac'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:51 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:40:51 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:40:51 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 25 10:40:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.351s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:40:51 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:40:51 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Deleted volume successfully. Sep 25 10:40:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7ad7928e-ec0d-4a03-9349-af4a1e49cd66 tempest-SnapshotMetadataTestJSON-378247306 None] Lock "cinder-c5ea43f3-47f1-4002-b7a4-6dc5de67fcae-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Flow 'volume_create_manager' (0d5e5160-163a-4832-84f7-3551bf02f2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831f45cc-591e-4b37-9f00-d96b892a1ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831f45cc-591e-4b37-9f00-d96b892a1ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-233021371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba6a7f0569452c8de3a65b6bb8a067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:00Z,use_quota=True,user_id='c491ec1f7dcd4539a966e62036ca45e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b81f2f-969b-43b6-86f4-9037dd876ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b81f2f-969b-43b6-86f4-9037dd876ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac7636f-abce-4f14-a5fd-94d7e5ebf03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac7636f-abce-4f14-a5fd-94d7e5ebf03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8', 'volume_name': 'volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e892e3-4459-4e36-af0c-8f805ba62d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e892e3-4459-4e36-af0c-8f805ba62d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd40e9c-e3c6-4296-ad22-24585c80860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:40:59 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Volume ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8', 'volume_size': 1} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-233021371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba6a7f0569452c8de3a65b6bb8a067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:00Z,use_quota=True,user_id='c491ec1f7dcd4539a966e62036ca45e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Creating volume ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:40:59 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:40:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:40:59 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 1073741824 Sep 25 10:40:59 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:00 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 1073741824" returned: 0 in 0.848s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:00 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 Sep 25 10:41:00 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Flow 'volume_create_manager' (bc052b9d-5005-445b-a1c1-fd9f96558ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f34466c-b813-4abc-a5a8-590ade8d7853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f34466c-b813-4abc-a5a8-590ade8d7853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-477040540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77288432-7c46-46a0-8633-ddce601d674e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7fab8ec0894143af88bab7f69e04db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:01Z,use_quota=True,user_id='c916ea3551d24da0a01ebc43b709350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f5d3aa-c119-47c6-abc7-95cbd8279a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f5d3aa-c119-47c6-abc7-95cbd8279a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8f8e57-fb1d-40d6-b4d2-e9209183d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8f8e57-fb1d-40d6-b4d2-e9209183d32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77288432-7c46-46a0-8633-ddce601d674e', 'volume_name': 'volume-77288432-7c46-46a0-8633-ddce601d674e', 'volume_size': 2}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070cccf2-6554-42c7-a8ef-863bbad77467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070cccf2-6554-42c7-a8ef-863bbad77467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d02ab7-4e78-4491-bebb-0758b57ffa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Volume 77288432-7c46-46a0-8633-ddce601d674e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77288432-7c46-46a0-8633-ddce601d674e', 'volume_size': 2} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:01 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" returned: 0 in 0.608s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-477040540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77288432-7c46-46a0-8633-ddce601d674e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7fab8ec0894143af88bab7f69e04db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:01Z,use_quota=True,user_id='c916ea3551d24da0a01ebc43b709350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Creating volume 77288432-7c46-46a0-8633-ddce601d674e {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:01 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e 2147483648 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd40e9c-e3c6-4296-ad22-24585c80860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:01 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e 2147483648 Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996eb58d-3a61-4437-b3a2-d4938b4ea0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:01 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:01 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Volume volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 (ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8): created successfully Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996eb58d-3a61-4437-b3a2-d4938b4ea0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Flow 'volume_create_manager' (0d5e5160-163a-4832-84f7-3551bf02f2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:01 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8b00c4cf-52c5-4bfc-bdf4-d10e8ab1b9aa tempest-VolumesDeleteCascade-1939994958 None] Created volume successfully. Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:02 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e 2147483648" returned: 0 in 0.835s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:02 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e Sep 25 10:41:02 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:02 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e" returned: 0 in 0.351s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.544s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d02ab7-4e78-4491-bebb-0758b57ffa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77288432-7c46-46a0-8633-ddce601d674e', 'volume_size': 2}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b769326-5e2f-4c7b-9c6b-027c4f7911e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Creating offline snapshot 7142366b-6173-4069-8b1f-48560c27c481 of volume ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:41:02 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Volume volume-77288432-7c46-46a0-8633-ddce601d674e (77288432-7c46-46a0-8633-ddce601d674e): created successfully Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b769326-5e2f-4c7b-9c6b-027c4f7911e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Flow 'volume_create_manager' (bc052b9d-5005-445b-a1c1-fd9f96558ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdfc996-470d-450e-98db-bf7b0e3c7d36]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:02 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ef71c01d-99e9-49de-953d-d6f522909e53 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Created volume successfully. Sep 25 10:41:02 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 Sep 25 10:41:02 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:03 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" returned: 0 in 0.576s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:03 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 1G Sep 25 10:41:03 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:03 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:41:03 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:03 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.386s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:41:03 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 1G" returned: 0 in 0.648s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:03 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 Sep 25 10:41:03 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:04 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481" returned: 0 in 0.424s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:04 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 is being set with open permissions: ugo+rw Sep 25 10:41:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:04 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 Sep 25 10:41:04 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:04 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481" returned: 0 in 0.298s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:04 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.info Sep 25 10:41:04 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:05 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.info" returned: 0 in 0.299s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:05 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.info is being set with open permissions: ugo+rw Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:05 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.info Sep 25 10:41:05 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:05 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.info" returned: 0 in 0.336s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.832s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Creating offline snapshot b71ce219-6030-4009-903a-f2c755730080 of volume 77288432-7c46-46a0-8633-ddce601d674e {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:41:05 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-813f5064-c379-4335-96a2-eaf1bd944597 tempest-VolumesDeleteCascade-1939994958 None] Create snapshot completed successfully Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[924253c7-7002-4599-be57-7c76d336af2c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:05 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e Sep 25 10:41:05 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Flow 'volume_create_manager' (2620fea8-ae77-4718-a865-053a53c23e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63d4949-9d27-4d9c-9542-979f9cb5928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63d4949-9d27-4d9c-9542-979f9cb5928f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-807507958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0849f32920d24f30b06afcb35b757dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:06Z,use_quota=True,user_id='1212ef3e52764d61a416dd90b1333d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ac59a4-e9aa-44bf-8834-dbe2f5fb7a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ac59a4-e9aa-44bf-8834-dbe2f5fb7a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab4ee2b-69ec-44dd-bcbe-40813ba63faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab4ee2b-69ec-44dd-bcbe-40813ba63faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6', 'volume_name': 'volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3af6fa3-26c3-4427-91fc-14a917ff75a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3af6fa3-26c3-4427-91fc-14a917ff75a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d0989f-6057-4d14-9f8e-701d571ae5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:06 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Volume 09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6', 'volume_size': 1} Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:06 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e" returned: 0 in 0.620s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 2G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:06 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 2G Sep 25 10:41:06 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:06 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 2G" returned: 0 in 0.747s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77288432-7c46-46a0-8633-ddce601d674e -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:06 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77288432-7c46-46a0-8633-ddce601d674e -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 Sep 25 10:41:06 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:07 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77288432-7c46-46a0-8633-ddce601d674e -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080" returned: 0 in 0.380s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:07 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 is being set with open permissions: ugo+rw Sep 25 10:41:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:07 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 Sep 25 10:41:07 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:07 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080" returned: 0 in 0.314s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:07 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.info Sep 25 10:41:07 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:07 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.info" returned: 0 in 0.300s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:07 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.info is being set with open permissions: ugo+rw Sep 25 10:41:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:07 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.info Sep 25 10:41:07 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:08 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.info" returned: 0 in 0.298s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.816s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.179s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-807507958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0849f32920d24f30b06afcb35b757dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:06Z,use_quota=True,user_id='1212ef3e52764d61a416dd90b1333d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Creating volume 09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:08 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:41:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:08 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 1073741824 Sep 25 10:41:08 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:08 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7e541242-a762-4891-a644-7611d5615985 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Create snapshot completed successfully Sep 25 10:41:09 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 1073741824" returned: 0 in 0.854s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Acquiring lock "cinder-b71ce219-6030-4009-903a-f2c755730080-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "cinder-b71ce219-6030-4009-903a-f2c755730080-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Acquiring lock "cinder-quobyte-77288432-7c46-46a0-8633-ddce601d674e" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:09 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 Sep 25 10:41:09 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "cinder-quobyte-77288432-7c46-46a0-8633-ddce601d674e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Acquiring lock "cinder-quobyte-b71ce219-6030-4009-903a-f2c755730080" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "cinder-quobyte-b71ce219-6030-4009-903a-f2c755730080" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Deleting offline snapshot b71ce219-6030-4009-903a-f2c755730080 of volume 77288432-7c46-46a0-8633-ddce601d674e {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] snapshot_file for this snap is: volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c683e9d-c5a0-4d1e-be03-45f8134e54bf]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:09 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 Sep 25 10:41:09 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:09 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6" returned: 0 in 0.554s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d0989f-6057-4d14-9f8e-701d571ae5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53739be-b344-4b95-9393-36648439a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] Creating offline snapshot eeeb7df5-9740-46bf-9a22-d38cf4817f37 of volume ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:41:09 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Volume volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 (09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6): created successfully Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53739be-b344-4b95-9393-36648439a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Flow 'volume_create_manager' (2620fea8-ae77-4718-a865-053a53c23e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f3c22e-0f0c-4e36-834f-3a85a2e44b90]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d7b50a64-515f-4074-a8ea-6ed46729ec09 tempest-VolumesMetadataTest-395228769 None] Created volume successfully. Sep 25 10:41:10 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080" returned: 0 in 0.718s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77288432-7c46-46a0-8633-ddce601d674e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:41:10 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 Sep 25 10:41:10 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:10 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d4e50e-6e9f-495b-9c30-000ad7da8e53]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:10 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e Sep 25 10:41:10 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:10 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481" returned: 0 in 0.538s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:41:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:10 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 1G Sep 25 10:41:10 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:10 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e" returned: 0 in 0.567s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:10 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 Sep 25 10:41:10 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:11 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 1G" returned: 0 in 0.658s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:11 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 Sep 25 10:41:11 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:11 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080" returned: 0 in 0.571s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:11 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080 Sep 25 10:41:11 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Acquiring lock "cinder-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Lock "cinder-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Acquiring lock "cinder-quobyte-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Lock "cinder-quobyte-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6" acquired by "delete_volume" :: waited 0.043s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[383e7eb4-87a9-435f-b290-db05de5bf222]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:11 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37" returned: 0 in 0.673s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:11 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 is being set with open permissions: ugo+rw Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:11 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e.b71ce219-6030-4009-903a-f2c755730080" returned: 0 in 0.600s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:11 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 Sep 25 10:41:11 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:11 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 Sep 25 10:41:11 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "cinder-quobyte-b71ce219-6030-4009-903a-f2c755730080" released by "_delete_snapshot" :: held 2.709s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "cinder-quobyte-77288432-7c46-46a0-8633-ddce601d674e" released by "delete_snapshot" :: held 2.757s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Created reservations ['880ecbc4-2aab-4b6a-9edc-7a3c35cd10db', 'd6fa5427-c612-4847-a1ef-c2df0d53ecdc', '08401509-523c-4bce-96ab-f0d9fbd5f35a', '3e7e08c2-ec85-4064-8587-942ba7741ea2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:12 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Delete snapshot completed successfully. Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7a5d302b-7866-42c8-950f-f5b7bc851e31 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "cinder-b71ce219-6030-4009-903a-f2c755730080-delete_snapshot" released by "delete_snapshot" :: held 3.078s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:12 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37" returned: 0 in 0.563s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:12 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6" returned: 0 in 0.771s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:12 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6 Sep 25 10:41:12 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.678s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:12 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-30f01ed3-5fd9-4d14-a68a-beb6de091d23 tempest-VolumesDeleteCascade-1939994958 None] Create snapshot completed successfully Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Acquiring lock "cinder-77288432-7c46-46a0-8633-ddce601d674e-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "cinder-77288432-7c46-46a0-8633-ddce601d674e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Acquiring lock "cinder-quobyte-77288432-7c46-46a0-8633-ddce601d674e" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "cinder-quobyte-77288432-7c46-46a0-8633-ddce601d674e" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:12 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc322d-d70e-4163-a0d1-908a06da9dda]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Lock "cinder-quobyte-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6" released by "delete_volume" :: held 1.213s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Created reservations ['0aa550c4-ffee-4d46-9ff1-c4001dad68f6', '79ce7770-5662-4753-80a1-43133da9fadf', 'f55a8a6a-c104-4b72-a540-0eedd84be017', '0f3101de-9558-47bb-be2f-9a347db99216'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:12 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e Sep 25 10:41:12 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:12 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:41:12 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:13 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e" returned: 0 in 0.568s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:13 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:13 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e Sep 25 10:41:13 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.489s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:13 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Deleted volume successfully. Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Performing cascade delete. {{(pid=87242) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e30958d8-0ee0-4476-bc30-0f75d4dd1a91 tempest-VolumesMetadataTest-395228769 None] Lock "cinder-09c4b959-2b57-41ee-8b7d-4f7d4bc99fd6-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-7142366b-6173-4069-8b1f-48560c27c481-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-7142366b-6173-4069-8b1f-48560c27c481-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-7142366b-6173-4069-8b1f-48560c27c481" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-7142366b-6173-4069-8b1f-48560c27c481" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Deleting offline snapshot 7142366b-6173-4069-8b1f-48560c27c481 of volume ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] snapshot_file for this snap is: volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e35d0-000b-4207-8651-9f7fe393d0c1]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:13 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-77288432-7c46-46a0-8633-ddce601d674e" returned: 0 in 0.419s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "cinder-quobyte-77288432-7c46-46a0-8633-ddce601d674e" released by "delete_volume" :: held 1.095s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:13 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Created reservations ['b5f58788-e5df-41c9-af33-2f8b2b394efc', 'c7fea626-ccd1-4241-b61e-fe698e30af0e', 'd38f74cc-2f70-4e75-a2f8-f10c0729dbc9', 'ba44f71b-7773-42f3-a93a-42154731a4b8'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:13 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 Sep 25 10:41:13 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:14 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:41:14 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:14 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.380s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:14 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Deleted volume successfully. Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:14 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (5a6f7499-8648-4fd4-b1c3-0beceee7986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9a59c9-d92d-4e3c-a959-84511ff44282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481" returned: 0 in 0.927s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-89995961-0c2e-4d0c-85a9-eb127a4ab613 tempest-VolumesSnapshotNegativeTestJSON-722114796 None] Lock "cinder-77288432-7c46-46a0-8633-ddce601d674e-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14b5050-a731-4b14-b0f3-0e15442d1567]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9a59c9-d92d-4e3c-a959-84511ff44282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31241052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:14Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfaea23-162b-44e5-9cc3-7a39e6aa002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfaea23-162b-44e5-9cc3-7a39e6aa002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33dec33b-b2f7-4d54-90d9-ff2109915add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33dec33b-b2f7-4d54-90d9-ff2109915add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c', 'volume_name': 'volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695faac2-1fdc-4d41-9b84-ac765023a3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695faac2-1fdc-4d41-9b84-ac765023a3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aeb17f1-72d4-4758-8ce9-0d5c6f80da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:14 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Volume 6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c', 'volume_size': 1} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31241052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:14Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Creating volume 6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:14 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:14 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c 1073741824 Sep 25 10:41:14 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:14 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 Sep 25 10:41:14 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:15 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" returned: 0 in 0.573s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:15 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec7f59c-14b6-42ca-866b-5d0de31dbae2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:15 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c 1073741824" returned: 0 in 0.685s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:15 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c Sep 25 10:41:15 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:15 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 Sep 25 10:41:15 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:15 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c" returned: 0 in 0.515s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:41:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aeb17f1-72d4-4758-8ce9-0d5c6f80da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ab49ad-8d1d-4763-8cee-673dfac90fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:16 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Volume volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c (6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c): created successfully Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ab49ad-8d1d-4763-8cee-673dfac90fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (5a6f7499-8648-4fd4-b1c3-0beceee7986d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-db21472f-46f3-4f08-93d9-81da9766536d tempest-VolumesActionsTest-1403210674 None] Created volume successfully. Sep 25 10:41:16 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37" returned: 0 in 0.763s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[007f74cd-8b1c-401c-bc0e-728831951299]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:16 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 Sep 25 10:41:16 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fe5cd239-43de-4136-9186-738a310b20f8 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c" by "attach_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fe5cd239-43de-4136-9186-738a310b20f8 tempest-VolumesActionsTest-1403210674 None] Lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c" acquired by "attach_volume" :: waited 0.055s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-fe5cd239-43de-4136-9186-738a310b20f8 tempest-VolumesActionsTest-1403210674 None] Attaching volume 6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c to instance fe9cc929-e279-4e7e-a487-e25d3fd14e74 at mountpoint /dev/vdb on host None. Sep 25 10:41:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-fe5cd239-43de-4136-9186-738a310b20f8 tempest-VolumesActionsTest-1403210674 None] Attach volume completed successfully. Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fe5cd239-43de-4136-9186-738a310b20f8 tempest-VolumesActionsTest-1403210674 None] Lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c" released by "attach_volume" :: held 0.228s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:16 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481" returned: 0 in 0.810s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49ce231-f165-47dc-9a1e-592bdc17d6f9]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:17 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 Sep 25 10:41:17 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:17 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" returned: 0 in 0.719s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:17 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 Sep 25 10:41:17 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-42b865fc-453e-4567-a761-c7b2e47858d0 tempest-VolumesActionsTest-1232049782 None] Terminate volume connection completed successfully. Sep 25 10:41:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-42b865fc-453e-4567-a761-c7b2e47858d0 tempest-VolumesActionsTest-1232049782 None] Acquiring lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c-detach_volume" by "detach_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-42b865fc-453e-4567-a761-c7b2e47858d0 tempest-VolumesActionsTest-1232049782 None] Lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-42b865fc-453e-4567-a761-c7b2e47858d0 tempest-VolumesActionsTest-1232049782 None] Detaching volume 6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c from instance fe9cc929-e279-4e7e-a487-e25d3fd14e74. Sep 25 10:41:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-42b865fc-453e-4567-a761-c7b2e47858d0 tempest-VolumesActionsTest-1232049782 None] Detach volume completed successfully. Sep 25 10:41:18 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481" returned: 0 in 0.811s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-42b865fc-453e-4567-a761-c7b2e47858d0 tempest-VolumesActionsTest-1232049782 None] Lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c-detach_volume" released by "detach_volume" :: held 0.136s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:18 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481 Sep 25 10:41:18 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6a52757c-c3b6-4868-87d6-351a2456c673 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c-detach_volume" by "detach_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6a52757c-c3b6-4868-87d6-351a2456c673 tempest-VolumesActionsTest-1403210674 None] Lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6a52757c-c3b6-4868-87d6-351a2456c673 tempest-VolumesActionsTest-1403210674 None] Volume detach called, but volume not attached. Sep 25 10:41:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6a52757c-c3b6-4868-87d6-351a2456c673 tempest-VolumesActionsTest-1403210674 None] Lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:18 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.7142366b-6173-4069-8b1f-48560c27c481" returned: 0 in 0.461s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 -F qcow2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:19 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 -F qcow2 Sep 25 10:41:19 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Acquiring lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Acquiring lock "cinder-quobyte-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Lock "cinder-quobyte-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:19 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c928c59a-457e-4127-81dd-030d98e29c04]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:19 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 -F qcow2" returned: 0 in 0.661s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-7142366b-6173-4069-8b1f-48560c27c481" released by "_delete_snapshot" :: held 6.104s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" released by "delete_snapshot" :: held 6.154s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:19 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c Sep 25 10:41:19 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:19 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Created reservations ['9133f58f-228c-4f31-a0c8-92716c436771', 'aa0c1bab-7abd-43ef-951c-4c2e74739f43', 'b114fca0-280b-4f77-b767-08e24c17d224', '94a702bf-6fa1-4e49-af2b-3f5b9d3e9392'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Delete snapshot completed successfully. Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-7142366b-6173-4069-8b1f-48560c27c481-delete_snapshot" released by "delete_snapshot" :: held 6.612s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-eeeb7df5-9740-46bf-9a22-d38cf4817f37-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-eeeb7df5-9740-46bf-9a22-d38cf4817f37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:20 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c" returned: 0 in 0.715s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:20 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c Sep 25 10:41:20 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-eeeb7df5-9740-46bf-9a22-d38cf4817f37" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-eeeb7df5-9740-46bf-9a22-d38cf4817f37" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Deleting offline snapshot eeeb7df5-9740-46bf-9a22-d38cf4817f37 of volume ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] snapshot_file for this snap is: volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6ad9f4-f4fd-4964-afa3-8c6d0f63897a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:20 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c" returned: 0 in 0.380s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Lock "cinder-quobyte-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c" released by "delete_volume" :: held 1.173s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:20 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 Sep 25 10:41:20 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Created reservations ['5e48d65a-1288-42a3-8a67-fd75b9b8286c', 'a7463693-2e01-43fd-9284-7a855a30ec2c', 'ef8c7965-e409-48b7-8dff-f538d44ea171', 'e2a49bdb-26d0-4a2a-98d5-55f204ccecb3'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:20 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:41:20 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:21 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37" returned: 0 in 0.848s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:41:21 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e18037-9f2f-4898-ac0b-f6c619662798]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:21 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.547s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:21 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Deleted volume successfully. Sep 25 10:41:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d307aa5c-f589-40a9-b013-e210c6f9d4ff tempest-VolumesActionsTest-1403210674 None] Lock "cinder-6ae3f5aa-c17e-4a00-b8c0-0857b5148a7c-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:21 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 Sep 25 10:41:21 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:22 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Flow 'volume_create_manager' (e81bbc65-1b91-4fc6-899f-ce423c0cee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0abe719-644e-4ff9-aaca-edca971cdc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" returned: 0 in 0.695s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:22 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0abe719-644e-4ff9-aaca-edca971cdc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-206968781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446ead7a-4630-4747-92bb-88fb722756ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753bdb5ca6b144a789e8480067a504a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:22Z,use_quota=True,user_id='fb664b1bca3948458cc15ecabfb2802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:22 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1da510c-821e-4213-950d-a2aaeadc8d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1da510c-821e-4213-950d-a2aaeadc8d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31aa8271-d7b9-409b-a565-76110cb392df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31aa8271-d7b9-409b-a565-76110cb392df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '446ead7a-4630-4747-92bb-88fb722756ca', 'volume_name': 'volume-446ead7a-4630-4747-92bb-88fb722756ca', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b7030b-2037-4861-870e-33daf6d185a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b7030b-2037-4861-870e-33daf6d185a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a31d2f-c0af-4484-a7c3-a420a511834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:22 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Volume 446ead7a-4630-4747-92bb-88fb722756ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-446ead7a-4630-4747-92bb-88fb722756ca', 'volume_size': 1} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-206968781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446ead7a-4630-4747-92bb-88fb722756ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753bdb5ca6b144a789e8480067a504a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:22Z,use_quota=True,user_id='fb664b1bca3948458cc15ecabfb2802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Creating volume 446ead7a-4630-4747-92bb-88fb722756ca {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:22 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:22 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca 1073741824 Sep 25 10:41:22 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:22 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37" returned: 0 in 0.623s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:22 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37 Sep 25 10:41:22 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:23 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca 1073741824" returned: 0 in 0.911s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:23 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca Sep 25 10:41:23 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:23 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8.eeeb7df5-9740-46bf-9a22-d38cf4817f37" returned: 0 in 0.739s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-eeeb7df5-9740-46bf-9a22-d38cf4817f37" released by "_delete_snapshot" :: held 3.141s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" released by "delete_snapshot" :: held 3.194s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Created reservations ['56dbe44f-9c8c-4148-8301-96c3daa5c400', 'af31d534-13d9-44e7-a44f-e7d951602c83', '3a234c9c-0c1d-4aad-9637-24fb8aabccc6', '3f57ba60-0a32-4352-9eb0-a6e4c37c8483'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:23 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca" returned: 0 in 0.508s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a31d2f-c0af-4484-a7c3-a420a511834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446ead7a-4630-4747-92bb-88fb722756ca', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be15a177-52b4-4a2f-a5b1-966fdb352520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Delete snapshot completed successfully. Sep 25 10:41:23 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Volume volume-446ead7a-4630-4747-92bb-88fb722756ca (446ead7a-4630-4747-92bb-88fb722756ca): created successfully Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be15a177-52b4-4a2f-a5b1-966fdb352520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Flow 'volume_create_manager' (e81bbc65-1b91-4fc6-899f-ce423c0cee4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-eeeb7df5-9740-46bf-9a22-d38cf4817f37-delete_snapshot" released by "delete_snapshot" :: held 3.736s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Snapshots deleted, issuing volume delete {{(pid=87242) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-69089125-f425-49c9-96e7-3e88cf99a0b1 tempest-VolumesCloneTest-668116885 None] Created volume successfully. Sep 25 10:41:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:24 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e000be9-bb64-4a25-94f1-8b86f61995a7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:24 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 Sep 25 10:41:24 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:24 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" returned: 0 in 0.718s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:24 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8 Sep 25 10:41:24 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:24 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Flow 'volume_create_manager' (c9a9d254-c969-4915-9ca8-ed65dbb327ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78293d5-34e5-4423-b9b9-9f550c7f510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78293d5-34e5-4423-b9b9-9f550c7f510f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1436871572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640bb452-6536-4784-af4a-e15c550919c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753bdb5ca6b144a789e8480067a504a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=446ead7a-4630-4747-92bb-88fb722756ca,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:25Z,use_quota=True,user_id='fb664b1bca3948458cc15ecabfb2802c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ad7ba8-6d3d-499c-a8ed-e837da61c439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ad7ba8-6d3d-499c-a8ed-e837da61c439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a03eea1-29ec-4a6e-a3ec-f5e873deefbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a03eea1-29ec-4a6e-a3ec-f5e873deefbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '640bb452-6536-4784-af4a-e15c550919c7', 'volume_name': 'volume-640bb452-6536-4784-af4a-e15c550919c7', 'volume_size': 2, 'source_volid': '446ead7a-4630-4747-92bb-88fb722756ca', 'source_volstatus': 'available'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec23b324-c42e-49b5-a334-41e3d28238d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec23b324-c42e-49b5-a334-41e3d28238d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7020139a-e132-46b9-9964-34e274ebcc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:25 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Volume 640bb452-6536-4784-af4a-e15c550919c7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-640bb452-6536-4784-af4a-e15c550919c7', 'volume_size': 2, 'source_volid': '446ead7a-4630-4747-92bb-88fb722756ca', 'source_volstatus': 'available'} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:25 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Cloning volume 446ead7a-4630-4747-92bb-88fb722756ca to volume 640bb452-6536-4784-af4a-e15c550919c7 Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Creating offline snapshot ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 of volume 446ead7a-4630-4747-92bb-88fb722756ca {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d77220c-d13d-4085-8980-750da3b80e25]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:25 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" returned: 0 in 0.411s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8" released by "delete_volume" :: held 1.233s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:25 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca Sep 25 10:41:25 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Created reservations ['59bc8122-2db5-42dd-b48a-db53fb914dbf', 'e5171ef2-9db3-455a-90a9-a4efdf4fd0e8', '4fb4ac97-f349-454a-8442-06a2d07aa5e6', '15735cc2-d9f8-4438-81c9-4588d8301870'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:25 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:41:25 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:25 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca" returned: 0 in 0.608s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:25 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 1G Sep 25 10:41:25 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:25 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.333s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:25 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Deleted volume successfully. Sep 25 10:41:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b264be0f-ffb8-4c27-8f1e-51a80d8035c2 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-ba4015ff-e64a-434f-aa2f-7bf3dbb0cbb8-delete_volume" released by "delete_volume" :: held 12.677s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:26 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 1G" returned: 0 in 0.682s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-446ead7a-4630-4747-92bb-88fb722756ca -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:26 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-446ead7a-4630-4747-92bb-88fb722756ca -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 Sep 25 10:41:26 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:26 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:26 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (97005b10-6622-466e-a0bc-574ca1297356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336ce909-14d5-4fcc-bb3f-258c49929339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-446ead7a-4630-4747-92bb-88fb722756ca -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7" returned: 0 in 0.549s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:26 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 is being set with open permissions: ugo+rw Sep 25 10:41:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:27 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 Sep 25 10:41:27 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336ce909-14d5-4fcc-bb3f-258c49929339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-581582322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ce8665-84e7-40a9-ba64-d82bb2b9e80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:27Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0ae4da-8eaa-4850-919f-3571e1abe8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0ae4da-8eaa-4850-919f-3571e1abe8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d13e10-2682-4cf3-b882-9aa5832f5b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d13e10-2682-4cf3-b882-9aa5832f5b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ce8665-84e7-40a9-ba64-d82bb2b9e80e', 'volume_name': 'volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3827d7c2-5abd-4b05-b8fc-0b344a2c6ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3827d7c2-5abd-4b05-b8fc-0b344a2c6ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c728de-4ab6-464f-a607-61ffe68a4ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:27 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Volume 00ce8665-84e7-40a9-ba64-d82bb2b9e80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e', 'volume_size': 1} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:27 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7" returned: 0 in 0.351s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Flow 'volume_create_manager' (2d1eedae-dacf-4204-8fa8-ee9338a4b4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b50973d-e2ff-4a14-b6dc-e8de6340aee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b50973d-e2ff-4a14-b6dc-e8de6340aee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1026479821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433d8c41-294d-4efb-a416-609ff0db4d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba6a7f0569452c8de3a65b6bb8a067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:27Z,use_quota=True,user_id='c491ec1f7dcd4539a966e62036ca45e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dc206b-b5f5-4af8-9d48-a14391828931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dc206b-b5f5-4af8-9d48-a14391828931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48aa0310-5a5c-40aa-af0f-e150135d00fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:27 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.info Sep 25 10:41:27 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48aa0310-5a5c-40aa-af0f-e150135d00fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433d8c41-294d-4efb-a416-609ff0db4d64', 'volume_name': 'volume-433d8c41-294d-4efb-a416-609ff0db4d64', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbffaad1-d898-40ce-a502-e69bb262e3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbffaad1-d898-40ce-a502-e69bb262e3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f379fd3c-db96-4e64-85d5-6c3b04338a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:27 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Volume 433d8c41-294d-4efb-a416-609ff0db4d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433d8c41-294d-4efb-a416-609ff0db4d64', 'volume_size': 1} Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:27 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.info" returned: 0 in 0.323s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:27 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.info is being set with open permissions: ugo+rw Sep 25 10:41:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:27 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.info Sep 25 10:41:27 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:28 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.info" returned: 0 in 0.333s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Acquiring lock "cinder-quobyte-640bb452-6536-4784-af4a-e15c550919c7" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Lock "cinder-quobyte-640bb452-6536-4784-af4a-e15c550919c7" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] snapshot: ad3d19ae-3c58-4f2f-a7bc-94289a3713e7, volume: 640bb452-6536-4784-af4a-e15c550919c7, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8345401-7967-4c13-917d-79ca8ad1c8d8]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:28 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 Sep 25 10:41:28 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:28 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7" returned: 0 in 0.431s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-446ead7a-4630-4747-92bb-88fb722756ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce4d15a-9c94-4cfe-9c50-40479e83ef51]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:28 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca Sep 25 10:41:28 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:29 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca" returned: 0 in 0.479s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:41:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:41:29 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:41:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:29 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 Sep 25 10:41:29 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:37 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=109,cinder:SELECT=88,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:41:37 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=97,cinder:UPDATE=96,cinder:DELETE=11,cinder:INSERT=24 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:41:37 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7" returned: 0 in 8.848s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:37 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca, size 1024.00 MB, duration 8.85 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:41:37 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Converted 1024.00 MB image at 115.72 MB/s Sep 25 10:41:37 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 is being set with open permissions: ugo+rw Sep 25 10:41:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:37 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 Sep 25 10:41:37 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:38 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7" returned: 0 in 0.290s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Lock "cinder-quobyte-640bb452-6536-4784-af4a-e15c550919c7" released by "_copy_volume_from_snapshot" :: held 10.152s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Acquiring lock "cinder-quobyte-ad3d19ae-3c58-4f2f-a7bc-94289a3713e7" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Lock "cinder-quobyte-ad3d19ae-3c58-4f2f-a7bc-94289a3713e7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Deleting offline snapshot ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 of volume 446ead7a-4630-4747-92bb-88fb722756ca {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] snapshot_file for this snap is: volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[585d322c-c152-4d39-b052-230cdc5032a2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:38 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 Sep 25 10:41:38 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:38 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7" returned: 0 in 0.428s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-446ead7a-4630-4747-92bb-88fb722756ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acb83e9-e0cb-492d-951b-bcd609805eaa]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:38 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca Sep 25 10:41:38 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:39 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca" returned: 0 in 0.636s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:39 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 Sep 25 10:41:39 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:39 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7" returned: 0 in 0.422s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:39 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7 Sep 25 10:41:39 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:40 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca.ad3d19ae-3c58-4f2f-a7bc-94289a3713e7" returned: 0 in 0.315s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Lock "cinder-quobyte-ad3d19ae-3c58-4f2f-a7bc-94289a3713e7" released by "_delete_snapshot" :: held 1.932s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.207s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.229s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-581582322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ce8665-84e7-40a9-ba64-d82bb2b9e80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:27Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Creating volume 00ce8665-84e7-40a9-ba64-d82bb2b9e80e {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:40 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:40 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e 1073741824 Sep 25 10:41:40 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7020139a-e132-46b9-9964-34e274ebcc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640bb452-6536-4784-af4a-e15c550919c7', 'volume_size': 2, 'source_volid': '446ead7a-4630-4747-92bb-88fb722756ca', 'source_volstatus': 'available'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374aed8a-50b0-4c5b-9e7a-063456250bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:40 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Volume volume-640bb452-6536-4784-af4a-e15c550919c7 (640bb452-6536-4784-af4a-e15c550919c7): created successfully Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374aed8a-50b0-4c5b-9e7a-063456250bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Flow 'volume_create_manager' (c9a9d254-c969-4915-9ca8-ed65dbb327ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:40 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e80e3090-6c07-4fa5-a77f-5b172e8690d6 tempest-VolumesCloneTest-668116885 None] Created volume successfully. Sep 25 10:41:40 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e 1073741824" returned: 0 in 0.580s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:40 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e Sep 25 10:41:40 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:41 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e" returned: 0 in 0.326s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.784s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1026479821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433d8c41-294d-4efb-a416-609ff0db4d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba6a7f0569452c8de3a65b6bb8a067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:27Z,use_quota=True,user_id='c491ec1f7dcd4539a966e62036ca45e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Creating volume 433d8c41-294d-4efb-a416-609ff0db4d64 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:41 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c728de-4ab6-464f-a607-61ffe68a4ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72322b83-9ac9-458f-a7b1-d90e3e913e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:41 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 1073741824 Sep 25 10:41:41 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:41 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Volume volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e (00ce8665-84e7-40a9-ba64-d82bb2b9e80e): created successfully Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72322b83-9ac9-458f-a7b1-d90e3e913e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (97005b10-6622-466e-a0bc-574ca1297356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d6f9976c-730a-4cb0-bb81-4650397fe748 tempest-VolumesActionsTest-1403210674 None] Created volume successfully. Sep 25 10:41:41 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 1073741824" returned: 0 in 0.699s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:42 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 Sep 25 10:41:42 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Acquiring lock "cinder-640bb452-6536-4784-af4a-e15c550919c7-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Lock "cinder-640bb452-6536-4784-af4a-e15c550919c7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Acquiring lock "cinder-quobyte-640bb452-6536-4784-af4a-e15c550919c7" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Lock "cinder-quobyte-640bb452-6536-4784-af4a-e15c550919c7" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bbff47-e682-4167-8d36-aeb50c5cafb8]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:42 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:42 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 Sep 25 10:41:42 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64" returned: 0 in 0.380s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f379fd3c-db96-4e64-85d5-6c3b04338a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433d8c41-294d-4efb-a416-609ff0db4d64', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb039f8f-4f31-49b2-92ce-9f38c3c2923e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:42 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Volume volume-433d8c41-294d-4efb-a416-609ff0db4d64 (433d8c41-294d-4efb-a416-609ff0db4d64): created successfully Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb039f8f-4f31-49b2-92ce-9f38c3c2923e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Flow 'volume_create_manager' (2d1eedae-dacf-4204-8fa8-ee9338a4b4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:42 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f5e0f041-1199-4df0-83f3-9e4290b8d7ac tempest-VolumesDeleteCascade-1939994958 None] Created volume successfully. Sep 25 10:41:42 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7" returned: 0 in 0.497s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Acquiring lock "cinder-00ce8665-84e7-40a9-ba64-d82bb2b9e80e-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:42 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7 Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Lock "cinder-00ce8665-84e7-40a9-ba64-d82bb2b9e80e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:42 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Acquiring lock "cinder-quobyte-00ce8665-84e7-40a9-ba64-d82bb2b9e80e" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Lock "cinder-quobyte-00ce8665-84e7-40a9-ba64-d82bb2b9e80e" acquired by "delete_volume" :: waited 0.036s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1df1334-caf9-4d8f-af4f-e3403960fd14]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:43 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e Sep 25 10:41:43 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:43 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-640bb452-6536-4784-af4a-e15c550919c7" returned: 0 in 0.416s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Lock "cinder-quobyte-640bb452-6536-4784-af4a-e15c550919c7" released by "delete_volume" :: held 1.010s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Creating offline snapshot 5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 of volume 433d8c41-294d-4efb-a416-609ff0db4d64 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccaa2dc-97e3-4e53-8b52-318b46022b91]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Created reservations ['485b2350-d0d6-460b-b83d-6ad0b0dfe10f', '48f7ae22-6cf1-41c7-b350-7b39ad275a23', '27b92066-d538-4c4e-8508-9224644dc4d4', '1a2d3821-0d46-49ac-9f09-21b7bbc87add'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:43 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:41:43 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:43 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 Sep 25 10:41:43 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:43 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e" returned: 0 in 0.609s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:43 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e Sep 25 10:41:43 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:43 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.327s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:43 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Deleted volume successfully. Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ac351bce-fa51-40c2-8af2-876e23f78f0b tempest-VolumesCloneTest-668116885 None] Lock "cinder-640bb452-6536-4784-af4a-e15c550919c7-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:43 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64" returned: 0 in 0.496s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:43 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 1G Sep 25 10:41:43 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:43 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce8665-84e7-40a9-ba64-d82bb2b9e80e" returned: 0 in 0.348s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Lock "cinder-quobyte-00ce8665-84e7-40a9-ba64-d82bb2b9e80e" released by "delete_volume" :: held 1.039s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Created reservations ['a73ee314-a468-41b7-aeb5-07c0c3a6e152', '765c097e-ef5e-47a8-a84b-9c3d60a871e0', '4788be18-4e89-4d75-a1a1-9bf11c942bff', '139e943d-ee04-492d-9d05-26fd35497b0c'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:44 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:41:44 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:44 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.325s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:44 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Deleted volume successfully. Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 1G" returned: 0 in 0.616s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-433d8c41-294d-4efb-a416-609ff0db4d64 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Acquiring lock "cinder-446ead7a-4630-4747-92bb-88fb722756ca-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:44 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-433d8c41-294d-4efb-a416-609ff0db4d64 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-aa2e33e1-4cac-4f77-8470-082c02e219b2 tempest-VolumesActionsTest-1232049782 None] Lock "cinder-00ce8665-84e7-40a9-ba64-d82bb2b9e80e-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:44 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Lock "cinder-446ead7a-4630-4747-92bb-88fb722756ca-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Acquiring lock "cinder-quobyte-446ead7a-4630-4747-92bb-88fb722756ca" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Lock "cinder-quobyte-446ead7a-4630-4747-92bb-88fb722756ca" acquired by "delete_volume" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b383c9f-83b0-4583-9970-98b359eac3e9]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:44 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca Sep 25 10:41:44 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:45 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-433d8c41-294d-4efb-a416-609ff0db4d64 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1" returned: 0 in 0.569s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:45 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 is being set with open permissions: ugo+rw Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:45 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 Sep 25 10:41:45 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:45 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca" returned: 0 in 0.717s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:45 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1" returned: 0 in 0.435s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:45 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca Sep 25 10:41:45 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:45 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.info Sep 25 10:41:45 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:45 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-446ead7a-4630-4747-92bb-88fb722756ca" returned: 0 in 0.455s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Lock "cinder-quobyte-446ead7a-4630-4747-92bb-88fb722756ca" released by "delete_volume" :: held 1.302s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (336f9f7c-093c-4e5a-9c08-3ea0c4f7af3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4d7954-d634-4ef5-b3ec-b52ae6988464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:46 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4d7954-d634-4ef5-b3ec-b52ae6988464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1607187319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0f85a2-bb1d-45b6-aac3-668533a79168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:46Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322d765c-231d-43f0-bc91-97f2f652b4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322d765c-231d-43f0-bc91-97f2f652b4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015df043-4319-4aed-ad92-5d3a821a5532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015df043-4319-4aed-ad92-5d3a821a5532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a0f85a2-bb1d-45b6-aac3-668533a79168', 'volume_name': 'volume-6a0f85a2-bb1d-45b6-aac3-668533a79168', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9610fb86-82d3-489b-9bd5-01ba0fded9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9610fb86-82d3-489b-9bd5-01ba0fded9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2134b085-7afb-4117-aede-d3f3fa1d82ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:46 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Volume 6a0f85a2-bb1d-45b6-aac3-668533a79168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a0f85a2-bb1d-45b6-aac3-668533a79168', 'volume_size': 1} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.info" returned: 0 in 0.511s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:46 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.info is being set with open permissions: ugo+rw Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:46 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.info Sep 25 10:41:46 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Created reservations ['31a0a069-a528-49fd-ad35-83dfd7bc50a7', 'a08c2816-91d9-4a63-b045-e861b939789a', '4d46a714-0a2c-4189-bf07-96009292e598', '07e52634-e68d-45b0-9356-7c35457c09a6'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:46 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:41:46 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:46 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.info" returned: 0 in 0.331s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.106s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1607187319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0f85a2-bb1d-45b6-aac3-668533a79168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:46Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Creating volume 6a0f85a2-bb1d-45b6-aac3-668533a79168 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:46 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:46 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168 1073741824 Sep 25 10:41:46 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:46 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8b4107b0-26f4-40b5-b099-67db5121bda5 tempest-VolumesDeleteCascade-1939994958 None] Create snapshot completed successfully Sep 25 10:41:46 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.321s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:46 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Deleted volume successfully. Sep 25 10:41:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-28059b5a-cb02-4a5a-a922-e036493ff7ba tempest-VolumesCloneTest-668116885 None] Lock "cinder-446ead7a-4630-4747-92bb-88fb722756ca-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:47 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168 1073741824" returned: 0 in 0.665s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:47 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168 Sep 25 10:41:47 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:47 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168" returned: 0 in 0.320s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:41:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2134b085-7afb-4117-aede-d3f3fa1d82ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0f85a2-bb1d-45b6-aac3-668533a79168', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de24a1f9-4a9c-4ea8-8636-4f765bedfb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:47 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Volume volume-6a0f85a2-bb1d-45b6-aac3-668533a79168 (6a0f85a2-bb1d-45b6-aac3-668533a79168): created successfully Sep 25 10:41:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de24a1f9-4a9c-4ea8-8636-4f765bedfb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (336f9f7c-093c-4e5a-9c08-3ea0c4f7af3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:47 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1459f70b-d209-4154-8829-ef52cc1977e8 tempest-VolumesActionsTest-1403210674 None] Created volume successfully. Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Acquiring lock "cinder-6a0f85a2-bb1d-45b6-aac3-668533a79168-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Lock "cinder-6a0f85a2-bb1d-45b6-aac3-668533a79168-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Flow 'volume_create_manager' (64cc4be9-c98d-4dc9-bb8a-31181d9bf84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20196a6c-d61d-4a21-8f91-fc4f45348b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20196a6c-d61d-4a21-8f91-fc4f45348b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1902427758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54b5a41-67ef-4e9a-8ead-a79254f970cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ba6a7f0569452c8de3a65b6bb8a067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:48Z,use_quota=True,user_id='c491ec1f7dcd4539a966e62036ca45e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911303b8-c68a-4301-b9ea-4a66cadf79ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911303b8-c68a-4301-b9ea-4a66cadf79ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa07f82b-6f10-4624-929e-bec5b8498a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa07f82b-6f10-4624-929e-bec5b8498a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f54b5a41-67ef-4e9a-8ead-a79254f970cc', 'volume_name': 'volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc', 'volume_size': 1, 'snapshot_id': '5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5cb85d-81b0-405a-be81-89e4e45ee2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5cb85d-81b0-405a-be81-89e4e45ee2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f13066-5f6f-4854-abf0-57ffa7198953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:48 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Volume f54b5a41-67ef-4e9a-8ead-a79254f970cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc', 'volume_size': 1, 'snapshot_id': '5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1'} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Acquiring lock "cinder-quobyte-6a0f85a2-bb1d-45b6-aac3-668533a79168" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1-f54b5a41-67ef-4e9a-8ead-a79254f970cc" by "_create_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Lock "cinder-quobyte-6a0f85a2-bb1d-45b6-aac3-668533a79168" acquired by "delete_volume" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1-f54b5a41-67ef-4e9a-8ead-a79254f970cc" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Creating volume f54b5a41-67ef-4e9a-8ead-a79254f970cc from snapshot 5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 {{(pid=87242) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-f54b5a41-67ef-4e9a-8ead-a79254f970cc" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7833da40-994d-4ce6-b3f1-708c66c29f52]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-f54b5a41-67ef-4e9a-8ead-a79254f970cc" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] snapshot: 5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1, volume: f54b5a41-67ef-4e9a-8ead-a79254f970cc, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec68ef1-e1bb-40e3-b028-9883108fc015]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:48 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168 Sep 25 10:41:48 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:49 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 Sep 25 10:41:49 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:49 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168" returned: 0 in 0.639s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:49 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168 Sep 25 10:41:49 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:49 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1" returned: 0 in 0.573s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-433d8c41-294d-4efb-a416-609ff0db4d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:41:49 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e1bee7-cb5a-49f6-a65c-920784a450ae]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:41:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:49 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 Sep 25 10:41:49 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:49 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6a0f85a2-bb1d-45b6-aac3-668533a79168" returned: 0 in 0.337s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Lock "cinder-quobyte-6a0f85a2-bb1d-45b6-aac3-668533a79168" released by "delete_volume" :: held 1.057s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:49 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Created reservations ['86636b64-aafa-49e7-bcfc-ce9f2af9da51', '33fd5e48-070c-4ce4-837f-8c2d2234ef80', 'c299ae25-e3ea-4dd3-9768-491901848371', 'ea9b928f-7cda-4543-92b4-3b216bfb0ef8'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:41:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:50 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:41:50 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:50 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64" returned: 0 in 0.599s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:50 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc Sep 25 10:41:50 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:50 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.507s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:41:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Deleted volume successfully. Sep 25 10:41:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a0a309b5-69f6-4caf-9bec-dfd0be602e56 tempest-VolumesActionsTest-1232049782 None] Lock "cinder-6a0f85a2-bb1d-45b6-aac3-668533a79168-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:51 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (cc50a0b4-d25e-46dc-9313-a2e694888277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e569c0-c1c1-4aea-bf30-f2216a979890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e569c0-c1c1-4aea-bf30-f2216a979890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-548504040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e381d0-9731-40cc-9a2c-07796709fdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:52Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd940c99-4102-4a93-8841-05ac45a28f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd940c99-4102-4a93-8841-05ac45a28f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839b2c5d-b48a-486a-b57c-bc9e56bde714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839b2c5d-b48a-486a-b57c-bc9e56bde714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e381d0-9731-40cc-9a2c-07796709fdad', 'volume_name': 'volume-12e381d0-9731-40cc-9a2c-07796709fdad', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb12696-6259-46aa-b866-ab1fbe40f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb12696-6259-46aa-b866-ab1fbe40f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f946cd79-eaf9-4d1f-8d70-36ac3478452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:52 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Volume 12e381d0-9731-40cc-9a2c-07796709fdad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e381d0-9731-40cc-9a2c-07796709fdad', 'volume_size': 1} Sep 25 10:41:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Flow 'volume_create_manager' (da558df2-3530-4fa1-b098-5cf81a461142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fc09ca-aa06-4e54-b16f-69a6e83a2d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fc09ca-aa06-4e54-b16f-69a6e83a2d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-53036714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a382f16-5b8c-4a21-ad14-5d5133f355ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e185a440ca6449e29d80bb1775026ac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:55Z,use_quota=True,user_id='34024e5a742543e3ade1cc86888c1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cff151e-9f14-4bb2-b159-b14677c1354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cff151e-9f14-4bb2-b159-b14677c1354f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc875d1-f519-47fb-b860-4b1568158303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc875d1-f519-47fb-b860-4b1568158303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a382f16-5b8c-4a21-ad14-5d5133f355ea', 'volume_name': 'volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea', 'volume_size': 2}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff58e68e-676b-44f1-9603-20429afa7294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff58e68e-676b-44f1-9603-20429afa7294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d82173e-9a80-4868-bed3-c1417e5636c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:54 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Volume 4a382f16-5b8c-4a21-ad14-5d5133f355ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea', 'volume_size': 2} Sep 25 10:41:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:58 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc" returned: 0 in 8.717s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:58 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:41:58 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Converted 1024.00 MB image at 117.44 MB/s Sep 25 10:41:58 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc is being set with open permissions: ugo+rw Sep 25 10:41:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:58 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc Sep 25 10:41:58 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:59 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc" returned: 0 in 0.406s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-f54b5a41-67ef-4e9a-8ead-a79254f970cc" released by "_copy_volume_from_snapshot" :: held 10.453s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1-f54b5a41-67ef-4e9a-8ead-a79254f970cc" released by "_create_volume_from_snapshot" :: held 10.560s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.609s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.045s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-548504040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e381d0-9731-40cc-9a2c-07796709fdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:52Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Creating volume 12e381d0-9731-40cc-9a2c-07796709fdad {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:41:59 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:59 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad 1073741824 Sep 25 10:41:59 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f13066-5f6f-4854-abf0-57ffa7198953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc', 'volume_size': 1, 'snapshot_id': '5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e522a8-38f5-4ccf-abd8-aac1fcc90d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:41:59 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Volume volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc (f54b5a41-67ef-4e9a-8ead-a79254f970cc): created successfully Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e522a8-38f5-4ccf-abd8-aac1fcc90d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Flow 'volume_create_manager' (64cc4be9-c98d-4dc9-bb8a-31181d9bf84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:41:59 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d1c49dbc-dc45-4561-9a8a-0ee6f7808e44 tempest-VolumesDeleteCascade-1939994958 None] Created volume successfully. Sep 25 10:41:59 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad 1073741824" returned: 0 in 0.528s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:41:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:41:59 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad Sep 25 10:41:59 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-433d8c41-294d-4efb-a416-609ff0db4d64-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-433d8c41-294d-4efb-a416-609ff0db4d64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Performing cascade delete. {{(pid=87242) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 10:42:00 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad" returned: 0 in 0.358s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.517s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-53036714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a382f16-5b8c-4a21-ad14-5d5133f355ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e185a440ca6449e29d80bb1775026ac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:41:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:41:55Z,use_quota=True,user_id='34024e5a742543e3ade1cc86888c1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Creating volume 4a382f16-5b8c-4a21-ad14-5d5133f355ea {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:00 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea 2147483648 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f946cd79-eaf9-4d1f-8d70-36ac3478452a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e381d0-9731-40cc-9a2c-07796709fdad', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:00 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea 2147483648 Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb8417e-a69a-4f00-9550-8dc7c999abc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:00 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:00 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Volume volume-12e381d0-9731-40cc-9a2c-07796709fdad (12e381d0-9731-40cc-9a2c-07796709fdad): created successfully Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb8417e-a69a-4f00-9550-8dc7c999abc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (cc50a0b4-d25e-46dc-9313-a2e694888277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-433d8c41-294d-4efb-a416-609ff0db4d64" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:00 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-884883c4-5eaf-4269-8c67-bc0190f19edd tempest-VolumesActionsTest-1403210674 None] Created volume successfully. Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-433d8c41-294d-4efb-a416-609ff0db4d64" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Deleting offline snapshot 5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 of volume 433d8c41-294d-4efb-a416-609ff0db4d64 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] snapshot_file for this snap is: volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d55b50c-82e5-45e1-89a3-fddc50f5d3b4]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:00 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 Sep 25 10:42:00 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:00 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1" returned: 0 in 0.449s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-433d8c41-294d-4efb-a416-609ff0db4d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7720dd3-2627-44e4-8acd-751d58553eea]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:01 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea 2147483648" returned: 0 in 0.885s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:01 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 Sep 25 10:42:01 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Acquiring lock "cinder-12e381d0-9731-40cc-9a2c-07796709fdad-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Lock "cinder-12e381d0-9731-40cc-9a2c-07796709fdad-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:01 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea Sep 25 10:42:01 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Acquiring lock "cinder-quobyte-12e381d0-9731-40cc-9a2c-07796709fdad" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Lock "cinder-quobyte-12e381d0-9731-40cc-9a2c-07796709fdad" acquired by "delete_volume" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b5aa64-10b7-4305-b582-a58b7eb1f16f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:01 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad Sep 25 10:42:01 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:01 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea" returned: 0 in 0.364s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d82173e-9a80-4868-bed3-c1417e5636c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea', 'volume_size': 2}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac70aed-3cbf-4868-a4bd-9cbf0b95cec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:01 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Volume volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea (4a382f16-5b8c-4a21-ad14-5d5133f355ea): created successfully Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac70aed-3cbf-4868-a4bd-9cbf0b95cec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Flow 'volume_create_manager' (da558df2-3530-4fa1-b098-5cf81a461142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:01 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-eea8fdc4-fd11-4cfd-a499-4d420634a99b tempest-VolumesCloneNegativeTest-2025939318 None] Created volume successfully. Sep 25 10:42:01 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64" returned: 0 in 0.799s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:01 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 Sep 25 10:42:01 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:01 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad" returned: 0 in 0.476s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:01 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad Sep 25 10:42:01 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:02 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-12e381d0-9731-40cc-9a2c-07796709fdad" returned: 0 in 0.338s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Lock "cinder-quobyte-12e381d0-9731-40cc-9a2c-07796709fdad" released by "delete_volume" :: held 0.905s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:02 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1" returned: 0 in 0.546s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Created reservations ['bd834552-bcbf-4c81-937a-8d1960e2b9bc', 'bf48509d-4a03-4a9c-9d5e-a14a853581a9', '843234de-b27a-4384-b0f6-578062e77222', 'c4461267-8237-41e6-ad15-1cc5fda5019b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:02 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1 Sep 25 10:42:02 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Acquiring lock "cinder-4a382f16-5b8c-4a21-ad14-5d5133f355ea-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Lock "cinder-4a382f16-5b8c-4a21-ad14-5d5133f355ea-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Acquiring lock "cinder-quobyte-4a382f16-5b8c-4a21-ad14-5d5133f355ea" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:02 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:02 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Lock "cinder-quobyte-4a382f16-5b8c-4a21-ad14-5d5133f355ea" acquired by "delete_volume" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cd2d5b-56a5-455a-bb5b-94bf15126f18]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:02 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64.5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1" returned: 0 in 0.424s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1" released by "_delete_snapshot" :: held 2.393s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-433d8c41-294d-4efb-a416-609ff0db4d64" released by "delete_snapshot" :: held 2.443s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:02 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea Sep 25 10:42:02 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:02 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.423s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:03 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Deleted volume successfully. Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Created reservations ['f2738194-6a4e-4fcb-a76d-5afc3463ed28', '0eb11c90-ffe2-4532-9b68-b7e912da16eb', 'f3c613f9-e465-4aa4-98b2-143b05c94b44', 'f08241e2-2b21-46d8-890b-27e3c7f13a88'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4588c038-7954-4c7f-ab15-c77d95bfebbc tempest-VolumesActionsTest-1232049782 None] Lock "cinder-12e381d0-9731-40cc-9a2c-07796709fdad-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:03 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Delete snapshot completed successfully. Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-5d9eac54-fd7b-48ac-9b85-cf9a3fd80cb1-delete_snapshot" released by "delete_snapshot" :: held 2.758s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Snapshots deleted, issuing volume delete {{(pid=87242) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-433d8c41-294d-4efb-a416-609ff0db4d64" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-433d8c41-294d-4efb-a416-609ff0db4d64" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca8b3d-d90d-44c4-aa8a-574ad4cce2c6]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:03 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea" returned: 0 in 0.575s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:03 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea Sep 25 10:42:03 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:03 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 Sep 25 10:42:03 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:03 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:03 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:03 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4a382f16-5b8c-4a21-ad14-5d5133f355ea" returned: 0 in 0.458s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Lock "cinder-quobyte-4a382f16-5b8c-4a21-ad14-5d5133f355ea" released by "delete_volume" :: held 1.130s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:03 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64" returned: 0 in 0.623s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:03 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64 Sep 25 10:42:03 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:03 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Created reservations ['dddb14c3-568d-48fa-bd0e-796a2f8e148e', '35f32526-990e-496c-b438-7dcad9f91e00', 'b1e1c304-1235-4af7-8082-99c06db20167', '8be720f6-6035-48e5-9d71-9d5559922e22'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:04 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.510s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:42:04 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:04 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:04 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-433d8c41-294d-4efb-a416-609ff0db4d64" returned: 0 in 0.481s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-433d8c41-294d-4efb-a416-609ff0db4d64" released by "delete_volume" :: held 1.218s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:04 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Created reservations ['a800bc19-316c-468c-ac67-7beef6b93891', 'afb355c2-ace7-40e3-a38f-f4676f55fca7', '21f838ff-85c1-4a5a-ac63-147dff0c3341', 'f59b6281-2511-483e-8dc8-d15e503ab635'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.427s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Deleted volume successfully. Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-eaf2caf7-e7a8-4ecc-95b5-33e7ba9d29b2 tempest-VolumesCloneNegativeTest-2025939318 None] Lock "cinder-4a382f16-5b8c-4a21-ad14-5d5133f355ea-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (d3c2921c-5e57-4e68-9b11-ed03a7bb4bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c604653e-3fd0-4c0e-93ca-db4099c18579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c604653e-3fd0-4c0e-93ca-db4099c18579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-731764492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50da63e-303f-4e40-afc7-9912a4f059fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:04Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678140bc-3225-42a4-895a-bd41ec475d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678140bc-3225-42a4-895a-bd41ec475d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e421c2f-9fe3-4cfa-9ce7-ee2314e7a294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e421c2f-9fe3-4cfa-9ce7-ee2314e7a294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50da63e-303f-4e40-afc7-9912a4f059fb', 'volume_name': 'volume-d50da63e-303f-4e40-afc7-9912a4f059fb', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09195859-3ab8-4755-8e42-402a96c4b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09195859-3ab8-4755-8e42-402a96c4b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a433b4-53a1-4184-8965-d0532a7025df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:04 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Volume d50da63e-303f-4e40-afc7-9912a4f059fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50da63e-303f-4e40-afc7-9912a4f059fb', 'volume_size': 1} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-731764492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50da63e-303f-4e40-afc7-9912a4f059fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:04Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Creating volume d50da63e-303f-4e40-afc7-9912a4f059fb {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:04 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:04 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb 1073741824 Sep 25 10:42:04 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:04 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:04 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-f54b5a41-67ef-4e9a-8ead-a79254f970cc-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-f54b5a41-67ef-4e9a-8ead-a79254f970cc-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:05 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.749s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:05 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Deleted volume successfully. Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "cinder-quobyte-f54b5a41-67ef-4e9a-8ead-a79254f970cc" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0c127afd-c114-405e-8746-93758ef06083 tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-433d8c41-294d-4efb-a416-609ff0db4d64-delete_volume" released by "delete_volume" :: held 5.505s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-f54b5a41-67ef-4e9a-8ead-a79254f970cc" acquired by "delete_volume" :: waited 0.055s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd340af-f958-4e75-9622-c8440a6fc4e0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:05 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb 1073741824" returned: 0 in 1.140s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:05 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc Sep 25 10:42:05 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:05 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb Sep 25 10:42:05 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:06 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb" returned: 0 in 0.537s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a433b4-53a1-4184-8965-d0532a7025df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50da63e-303f-4e40-afc7-9912a4f059fb', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ccbc97-bee6-4397-bf10-822d7cf1dd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:06 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc" returned: 0 in 0.763s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:06 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Volume volume-d50da63e-303f-4e40-afc7-9912a4f059fb (d50da63e-303f-4e40-afc7-9912a4f059fb): created successfully Sep 25 10:42:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ccbc97-bee6-4397-bf10-822d7cf1dd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (d3c2921c-5e57-4e68-9b11-ed03a7bb4bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:06 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc Sep 25 10:42:06 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:06 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d9110b66-e114-4c01-8599-6cf0542b18c7 tempest-VolumesActionsTest-1403210674 None] Created volume successfully. Sep 25 10:42:07 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f54b5a41-67ef-4e9a-8ead-a79254f970cc" returned: 0 in 0.517s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-quobyte-f54b5a41-67ef-4e9a-8ead-a79254f970cc" released by "delete_volume" :: held 1.365s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Created reservations ['a9212c71-1e86-4734-a06c-f9043016b9a3', 'e4df6045-6caf-4e4a-a309-7284b0ef5f99', 'ba6abfc8-db49-40b9-8499-8049aa12fc39', '0436c3b4-12dd-45e2-a525-f0ac08c80445'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Acquiring lock "cinder-d50da63e-303f-4e40-afc7-9912a4f059fb-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Lock "cinder-d50da63e-303f-4e40-afc7-9912a4f059fb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:07 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:07 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Acquiring lock "cinder-quobyte-d50da63e-303f-4e40-afc7-9912a4f059fb" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Lock "cinder-quobyte-d50da63e-303f-4e40-afc7-9912a4f059fb" acquired by "delete_volume" :: waited 0.044s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfccd63-7303-4e98-93ad-93b732485154]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:07 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb Sep 25 10:42:07 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:07 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.410s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Deleted volume successfully. Sep 25 10:42:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f6fdd88-6d52-404d-9dde-ed12c75fafbb tempest-VolumesDeleteCascade-1939994958 None] Lock "cinder-f54b5a41-67ef-4e9a-8ead-a79254f970cc-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:08 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb" returned: 0 in 0.637s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:08 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb Sep 25 10:42:08 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:08 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d50da63e-303f-4e40-afc7-9912a4f059fb" returned: 0 in 0.504s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Lock "cinder-quobyte-d50da63e-303f-4e40-afc7-9912a4f059fb" released by "delete_volume" :: held 1.224s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Created reservations ['fbd91d0b-be7f-4f74-a158-3c64ddd5b3cb', '6627efb7-f538-4bca-87bc-2bcac3cd9154', 'b33529c3-407d-4d5e-ac4f-dc431e66bee8', '62d8da7f-4430-4b89-a6dc-35b3e63889f2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:08 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:08 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:09 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.408s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:09 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Deleted volume successfully. Sep 25 10:42:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4e5d6d49-bcd6-4f4c-a175-322a511d887c tempest-VolumesActionsTest-1232049782 None] Lock "cinder-d50da63e-303f-4e40-afc7-9912a4f059fb-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (cc3c7b89-ddf9-4dfd-adcb-59785ed2cdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a29a33-c9dd-4bcf-966e-9a322c83288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a29a33-c9dd-4bcf-966e-9a322c83288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-423508660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:11Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77af2f03-102d-4906-b541-900fb28ad317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77af2f03-102d-4906-b541-900fb28ad317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02f3753-726b-4f5d-b8ea-6bc8273d0093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02f3753-726b-4f5d-b8ea-6bc8273d0093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee', 'volume_name': 'volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb01886-3c8a-4bbe-943d-1076e123561d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb01886-3c8a-4bbe-943d-1076e123561d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1086e06-b2a5-4352-9c87-512c0d0582d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:10 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Volume eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee', 'volume_size': 1} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-423508660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7a3aba104f4fd38a4221ac9720aaa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:11Z,use_quota=True,user_id='f5977e3d8da64512a0c1f22470ff5111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Creating volume eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:11 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:11 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee 1073741824 Sep 25 10:42:11 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:12 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee 1073741824" returned: 0 in 1.034s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:12 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee Sep 25 10:42:12 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:12 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee" returned: 0 in 0.567s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1086e06-b2a5-4352-9c87-512c0d0582d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc7e015-31d0-454d-b6a5-f1660e24f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:12 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Volume volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee (eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee): created successfully Sep 25 10:42:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc7e015-31d0-454d-b6a5-f1660e24f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Flow 'volume_create_manager' (cc3c7b89-ddf9-4dfd-adcb-59785ed2cdca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:12 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8208e9b6-8c8a-4e83-8e30-f5c74b9d40b9 tempest-VolumesActionsTest-1403210674 None] Created volume successfully. Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Flow 'volume_create_manager' (1f2d2dfe-ff52-46c2-a09c-c2c370a36c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34544d68-767d-49d9-a666-e257608d41bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34544d68-767d-49d9-a666-e257608d41bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1905303284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96db0ca-93d0-4cf7-8757-7613a37eae25,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74dbb4b626af45cebc058e5a426fdf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:14Z,use_quota=True,user_id='197595c83dc44b9ea853fe6262ddd5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f59c45-fcd2-4156-a0f2-cc9579b29b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f59c45-fcd2-4156-a0f2-cc9579b29b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d61d8b-6978-4e3a-92d8-ed067e5f05d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d61d8b-6978-4e3a-92d8-ed067e5f05d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd96db0ca-93d0-4cf7-8757-7613a37eae25', 'volume_name': 'volume-d96db0ca-93d0-4cf7-8757-7613a37eae25', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7e6171-96c3-493e-af99-42cb07629403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7e6171-96c3-493e-af99-42cb07629403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bca1a1-957f-4efc-bd38-5c97fb133e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:14 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Volume d96db0ca-93d0-4cf7-8757-7613a37eae25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d96db0ca-93d0-4cf7-8757-7613a37eae25', 'volume_size': 1} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1905303284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96db0ca-93d0-4cf7-8757-7613a37eae25,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74dbb4b626af45cebc058e5a426fdf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:14Z,use_quota=True,user_id='197595c83dc44b9ea853fe6262ddd5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Creating volume d96db0ca-93d0-4cf7-8757-7613a37eae25 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:14 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:14 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25 1073741824 Sep 25 10:42:14 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:15 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25 1073741824" returned: 0 in 0.740s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:15 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25 Sep 25 10:42:15 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "cinder-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Lock "cinder-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "cinder-quobyte-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Lock "cinder-quobyte-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee" acquired by "delete_volume" :: waited 0.035s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dc534a-3702-4dd7-86d2-36c24711df3e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:15 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee Sep 25 10:42:15 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:15 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25" returned: 0 in 0.579s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bca1a1-957f-4efc-bd38-5c97fb133e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d96db0ca-93d0-4cf7-8757-7613a37eae25', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4302c2b0-199d-4b4c-8f30-d736eaf2f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:15 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Volume volume-d96db0ca-93d0-4cf7-8757-7613a37eae25 (d96db0ca-93d0-4cf7-8757-7613a37eae25): created successfully Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4302c2b0-199d-4b4c-8f30-d736eaf2f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Flow 'volume_create_manager' (1f2d2dfe-ff52-46c2-a09c-c2c370a36c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:15 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c56ff977-f0e9-46c8-8adf-5bd3df192ba8 tempest-VolumesListTestJSON-1354762385 None] Created volume successfully. Sep 25 10:42:16 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee" returned: 0 in 0.809s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:16 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee Sep 25 10:42:16 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:17 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee" returned: 0 in 0.627s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Lock "cinder-quobyte-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee" released by "delete_volume" :: held 1.555s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Created reservations ['02dcd477-183a-443a-8ae4-3a2d1716fbd9', 'e45c9f7c-4a04-413c-b4f9-3b92af8a08fd', '64e04ec2-ef3e-4b67-89d7-e75bc574e495', 'f525b5d7-45f2-4bb5-84e6-dd3cb24052a5'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:17 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:17 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Flow 'volume_create_manager' (e4d0bd33-6bfc-4487-89f1-c8bfc92e0a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ad7d3d-2cff-4ba7-bf60-a2766fbdbd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ad7d3d-2cff-4ba7-bf60-a2766fbdbd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-318536700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4194619b-c694-4498-a854-531c951895f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74dbb4b626af45cebc058e5a426fdf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:18Z,use_quota=True,user_id='197595c83dc44b9ea853fe6262ddd5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bafc73-6075-4263-a38e-9e0e46c489cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bafc73-6075-4263-a38e-9e0e46c489cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52d5dfb-2032-4c5f-a26b-5517bb31482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52d5dfb-2032-4c5f-a26b-5517bb31482e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4194619b-c694-4498-a854-531c951895f6', 'volume_name': 'volume-4194619b-c694-4498-a854-531c951895f6', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843e2eb7-05ac-4175-aeee-0534470e9f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843e2eb7-05ac-4175-aeee-0534470e9f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d785e9-168a-4e5b-85c8-edf17364bb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:17 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Volume 4194619b-c694-4498-a854-531c951895f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4194619b-c694-4498-a854-531c951895f6', 'volume_size': 1} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-318536700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4194619b-c694-4498-a854-531c951895f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74dbb4b626af45cebc058e5a426fdf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:18Z,use_quota=True,user_id='197595c83dc44b9ea853fe6262ddd5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Creating volume 4194619b-c694-4498-a854-531c951895f6 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:17 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:17 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.537s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:17 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:17 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6 1073741824 Sep 25 10:42:17 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Deleted volume successfully. Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0af96bc6-496f-4384-bd17-0ba7171e4543 tempest-VolumesActionsTest-1403210674 None] Lock "cinder-eb47ea67-7ea8-4aaa-80fc-3d4fb109f8ee-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:18 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6 1073741824" returned: 0 in 0.814s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Flow 'volume_create_manager' (b0ed6b30-f5b1-4a6f-a0da-3def10753580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fbda70-dcb0-4766-9ebc-2984cfb0d6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fbda70-dcb0-4766-9ebc-2984cfb0d6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-185323423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd24276c-bf16-4c9b-815e-71ecc4a8646c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1953259e4887479e8b8e62f65ac50aa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:19Z,use_quota=True,user_id='4cd33dbfa6464aa6b0731c780676e851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136748da-6740-4b96-9fc9-e651a9f05753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136748da-6740-4b96-9fc9-e651a9f05753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5d4c14-4b0c-4398-b082-4d8a793a2a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5d4c14-4b0c-4398-b082-4d8a793a2a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd24276c-bf16-4c9b-815e-71ecc4a8646c', 'volume_name': 'volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5235e2d0-466a-4a34-89f8-ae7b9e13ed61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5235e2d0-466a-4a34-89f8-ae7b9e13ed61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e382a6ea-f0b9-416d-8a03-fefb3b6d5aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:18 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Volume bd24276c-bf16-4c9b-815e-71ecc4a8646c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c', 'volume_size': 1} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:18 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6 Sep 25 10:42:18 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Flow 'volume_create_manager' (e801cdcb-3f8b-4d05-890e-08b6764e8342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d59756-6129-4261-8004-97445ea1b84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d59756-6129-4261-8004-97445ea1b84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1128272345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8bd218-8846-4253-a9a3-63b7467e4af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4668e9bd512c48ec884a69c883272a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:19Z,use_quota=True,user_id='3fa7c34ffb6749ad8d5f9f6a7ecd22e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfa0fd4-5e0f-48d6-9028-8500b1494c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfa0fd4-5e0f-48d6-9028-8500b1494c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c85f48-474e-4ac1-99cb-14088035b1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c85f48-474e-4ac1-99cb-14088035b1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce8bd218-8846-4253-a9a3-63b7467e4af3', 'volume_name': 'volume-ce8bd218-8846-4253-a9a3-63b7467e4af3', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d4ea79-0ecf-4a91-b241-fc681d57e582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d4ea79-0ecf-4a91-b241-fc681d57e582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c6f6f8-0ba1-46f5-9e8d-36bd50f80499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:19 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Volume ce8bd218-8846-4253-a9a3-63b7467e4af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce8bd218-8846-4253-a9a3-63b7467e4af3', 'volume_size': 1} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:19 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6" returned: 0 in 0.353s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.364s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-185323423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd24276c-bf16-4c9b-815e-71ecc4a8646c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1953259e4887479e8b8e62f65ac50aa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:19Z,use_quota=True,user_id='4cd33dbfa6464aa6b0731c780676e851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Creating volume bd24276c-bf16-4c9b-815e-71ecc4a8646c {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:19 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d785e9-168a-4e5b-85c8-edf17364bb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4194619b-c694-4498-a854-531c951895f6', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:19 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c 1073741824 Sep 25 10:42:19 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834c8644-9bdd-4fbe-9f9a-3ccf3f5d3dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:19 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Volume volume-4194619b-c694-4498-a854-531c951895f6 (4194619b-c694-4498-a854-531c951895f6): created successfully Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834c8644-9bdd-4fbe-9f9a-3ccf3f5d3dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Flow 'volume_create_manager' (e4d0bd33-6bfc-4487-89f1-c8bfc92e0a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:19 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-41ab4957-91cf-41f1-8ff7-1178f5d825be tempest-VolumesListTestJSON-1354762385 None] Created volume successfully. Sep 25 10:42:20 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c 1073741824" returned: 0 in 0.748s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:20 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c Sep 25 10:42:20 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:20 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c" returned: 0 in 0.469s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.369s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1128272345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8bd218-8846-4253-a9a3-63b7467e4af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4668e9bd512c48ec884a69c883272a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:19Z,use_quota=True,user_id='3fa7c34ffb6749ad8d5f9f6a7ecd22e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Creating volume ce8bd218-8846-4253-a9a3-63b7467e4af3 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:20 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:20 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3 1073741824 Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e382a6ea-f0b9-416d-8a03-fefb3b6d5aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:20 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44583e2-8d51-4c2d-9007-9375aca2f135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Flow 'volume_create_manager' (93587f35-0257-45fa-996a-b75e407b47aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f24ad8-e16b-4a8a-aa1a-41d5ea774c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:20 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Volume volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c (bd24276c-bf16-4c9b-815e-71ecc4a8646c): created successfully Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44583e2-8d51-4c2d-9007-9375aca2f135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Flow 'volume_create_manager' (b0ed6b30-f5b1-4a6f-a0da-3def10753580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f24ad8-e16b-4a8a-aa1a-41d5ea774c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-423747460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69589fe8-c038-41b6-a40a-6feeb1508027,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74dbb4b626af45cebc058e5a426fdf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:21Z,use_quota=True,user_id='197595c83dc44b9ea853fe6262ddd5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47be2cd8-258d-4c30-ace8-6c9ab33191eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47be2cd8-258d-4c30-ace8-6c9ab33191eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556dad06-c546-42d3-977d-7f52cadd7903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556dad06-c546-42d3-977d-7f52cadd7903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69589fe8-c038-41b6-a40a-6feeb1508027', 'volume_name': 'volume-69589fe8-c038-41b6-a40a-6feeb1508027', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cc755b-9274-4882-9c66-9ecd289f0502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cc755b-9274-4882-9c66-9ecd289f0502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2762013e-0675-4838-9afe-c3524dd9ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:20 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Volume 69589fe8-c038-41b6-a40a-6feeb1508027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69589fe8-c038-41b6-a40a-6feeb1508027', 'volume_size': 1} Sep 25 10:42:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f315746d-d8b6-4fc0-b86c-0c415b9510f2 tempest-TestMinimumBasicScenario-1809780170 None] Created volume successfully. Sep 25 10:42:21 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3 1073741824" returned: 0 in 0.670s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:21 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3 Sep 25 10:42:21 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:21 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3" returned: 0 in 0.265s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-423747460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69589fe8-c038-41b6-a40a-6feeb1508027,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='74dbb4b626af45cebc058e5a426fdf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:21Z,use_quota=True,user_id='197595c83dc44b9ea853fe6262ddd5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Creating volume 69589fe8-c038-41b6-a40a-6feeb1508027 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:21 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c6f6f8-0ba1-46f5-9e8d-36bd50f80499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce8bd218-8846-4253-a9a3-63b7467e4af3', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:21 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027 1073741824 Sep 25 10:42:21 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319a76d6-2d2f-4539-bd49-2f98d2d0baa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:21 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Volume volume-ce8bd218-8846-4253-a9a3-63b7467e4af3 (ce8bd218-8846-4253-a9a3-63b7467e4af3): created successfully Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319a76d6-2d2f-4539-bd49-2f98d2d0baa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Flow 'volume_create_manager' (e801cdcb-3f8b-4d05-890e-08b6764e8342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3813b994-813c-440e-8ce7-eb066827bd3a tempest-VolumesTransfersV355Test-1708144283 None] Created volume successfully. Sep 25 10:42:22 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027 1073741824" returned: 0 in 0.623s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:22 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027 Sep 25 10:42:22 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:22 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027" returned: 0 in 0.405s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2762013e-0675-4838-9afe-c3524dd9ca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69589fe8-c038-41b6-a40a-6feeb1508027', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4405c92e-414e-46af-a3cd-d44756f6ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:22 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Volume volume-69589fe8-c038-41b6-a40a-6feeb1508027 (69589fe8-c038-41b6-a40a-6feeb1508027): created successfully Sep 25 10:42:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4405c92e-414e-46af-a3cd-d44756f6ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Flow 'volume_create_manager' (93587f35-0257-45fa-996a-b75e407b47aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1ba885a8-b26f-4262-a70a-b5ebc2f40492 tempest-VolumesListTestJSON-1354762385 None] Created volume successfully. Sep 25 10:42:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-496d8854-efd3-47b6-b9ab-6607ef71c2dc tempest-VolumesTransfersV355Test-1527224186 None] Transfer volume completed successfully. Sep 25 10:42:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-aa19b4d7-a78a-4dd1-902b-986447ea4796 req-71eb19ea-0cbf-463f-88b6-89000cb37bbb tempest-TestMinimumBasicScenario-1809780170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-aa19b4d7-a78a-4dd1-902b-986447ea4796 req-71eb19ea-0cbf-463f-88b6-89000cb37bbb tempest-TestMinimumBasicScenario-1809780170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-aa19b4d7-a78a-4dd1-902b-986447ea4796 req-71eb19ea-0cbf-463f-88b6-89000cb37bbb tempest-TestMinimumBasicScenario-1809780170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-aa19b4d7-a78a-4dd1-902b-986447ea4796 req-71eb19ea-0cbf-463f-88b6-89000cb37bbb tempest-TestMinimumBasicScenario-1809780170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c4639fa-0ba4-42a9-aa81-0f113cfe3a8c', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:42:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-aa19b4d7-a78a-4dd1-902b-986447ea4796 req-71eb19ea-0cbf-463f-88b6-89000cb37bbb tempest-TestMinimumBasicScenario-1809780170 None] attachment_update completed successfully. Sep 25 10:42:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Acquiring lock "cinder-ce8bd218-8846-4253-a9a3-63b7467e4af3-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Lock "cinder-ce8bd218-8846-4253-a9a3-63b7467e4af3-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Acquiring lock "cinder-quobyte-ce8bd218-8846-4253-a9a3-63b7467e4af3" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Lock "cinder-quobyte-ce8bd218-8846-4253-a9a3-63b7467e4af3" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:25 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d764c3e-5a6a-4539-b794-e80eb9210c31]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:25 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3 Sep 25 10:42:25 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:25 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3" returned: 0 in 0.686s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:26 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3 Sep 25 10:42:26 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:26 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ce8bd218-8846-4253-a9a3-63b7467e4af3" returned: 0 in 0.476s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Lock "cinder-quobyte-ce8bd218-8846-4253-a9a3-63b7467e4af3" released by "delete_volume" :: held 1.262s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:26 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Created reservations ['4a8158dc-aad0-4933-ab6f-7e0cc2b915d2', 'd3097e33-af5c-4e23-b796-1f3090f6dc25', 'f3c7de13-0658-4d33-8d01-28a584c073c7', '19d68296-ce19-4b95-a8c9-aec6625ecf2a'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:26 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:26 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:27 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.553s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:27 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:27 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Deleted volume successfully. Sep 25 10:42:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4a08442-3ea1-4de2-b838-beab2fdb9146 tempest-VolumesTransfersV355Test-828231760 None] Lock "cinder-ce8bd218-8846-4253-a9a3-63b7467e4af3-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Flow 'volume_create_manager' (414f6b87-1ebe-4e65-ad58-a2eeeef7d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d8af55-8999-4e1d-bc4d-2787d46c5f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d8af55-8999-4e1d-bc4d-2787d46c5f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-375444670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd45847e-fb8f-4309-9d53-2eea6d93da90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4668e9bd512c48ec884a69c883272a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:28Z,use_quota=True,user_id='3fa7c34ffb6749ad8d5f9f6a7ecd22e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0eb4b8-9d73-4b86-8f6b-a39da9c8b608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0eb4b8-9d73-4b86-8f6b-a39da9c8b608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52542460-8fba-481a-a458-c75d7eb75b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52542460-8fba-481a-a458-c75d7eb75b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd45847e-fb8f-4309-9d53-2eea6d93da90', 'volume_name': 'volume-bd45847e-fb8f-4309-9d53-2eea6d93da90', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894f36c0-1710-4809-b80c-e95afe2ce4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894f36c0-1710-4809-b80c-e95afe2ce4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226e16f8-a758-4c7f-9fa0-e242ec19f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:28 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Volume bd45847e-fb8f-4309-9d53-2eea6d93da90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd45847e-fb8f-4309-9d53-2eea6d93da90', 'volume_size': 1} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-375444670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd45847e-fb8f-4309-9d53-2eea6d93da90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4668e9bd512c48ec884a69c883272a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:28Z,use_quota=True,user_id='3fa7c34ffb6749ad8d5f9f6a7ecd22e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Creating volume bd45847e-fb8f-4309-9d53-2eea6d93da90 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:28 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:28 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90 1073741824 Sep 25 10:42:28 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "cinder-69589fe8-c038-41b6-a40a-6feeb1508027-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-69589fe8-c038-41b6-a40a-6feeb1508027-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:29 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90 1073741824" returned: 0 in 0.923s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "cinder-quobyte-69589fe8-c038-41b6-a40a-6feeb1508027" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-quobyte-69589fe8-c038-41b6-a40a-6feeb1508027" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:29 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[28725cab-6075-41de-b45f-74d0e75c74c2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:29 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90 Sep 25 10:42:29 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:30 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027 Sep 25 10:42:30 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:30 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90" returned: 0 in 0.345s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226e16f8-a758-4c7f-9fa0-e242ec19f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd45847e-fb8f-4309-9d53-2eea6d93da90', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc57fdc-9fc1-4fa1-874c-b4f03b9e3107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:30 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Volume volume-bd45847e-fb8f-4309-9d53-2eea6d93da90 (bd45847e-fb8f-4309-9d53-2eea6d93da90): created successfully Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc57fdc-9fc1-4fa1-874c-b4f03b9e3107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Flow 'volume_create_manager' (414f6b87-1ebe-4e65-ad58-a2eeeef7d946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d227576a-146f-4198-811f-cddb1429b616 tempest-VolumesTransfersV355Test-1708144283 None] Created volume successfully. Sep 25 10:42:30 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027" returned: 0 in 0.522s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:30 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027 Sep 25 10:42:30 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:30 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69589fe8-c038-41b6-a40a-6feeb1508027" returned: 0 in 0.302s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-quobyte-69589fe8-c038-41b6-a40a-6feeb1508027" released by "delete_volume" :: held 0.914s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Created reservations ['811e2919-6a25-496b-a2b4-5ec4b4b48536', 'f76d141a-1d57-4adb-8416-92c727678e97', 'd20eae8a-ce88-431f-aeaf-db26ced371fb', '96a5bf10-fa6d-495d-ae7f-e9041b6117b2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:30 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:30 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "cinder-4194619b-c694-4498-a854-531c951895f6-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-4194619b-c694-4498-a854-531c951895f6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "cinder-quobyte-4194619b-c694-4498-a854-531c951895f6" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-quobyte-4194619b-c694-4498-a854-531c951895f6" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4654659-325d-42e9-af20-f2a62c5331e0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Acquiring lock "cinder-bd45847e-fb8f-4309-9d53-2eea6d93da90-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Lock "cinder-bd45847e-fb8f-4309-9d53-2eea6d93da90-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:31 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.494s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:31 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Deleted volume successfully. Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c67c6dc-a6bb-400f-adf6-4e77bbafd77e tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-69589fe8-c038-41b6-a40a-6feeb1508027-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Acquiring lock "cinder-quobyte-bd45847e-fb8f-4309-9d53-2eea6d93da90" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Lock "cinder-quobyte-bd45847e-fb8f-4309-9d53-2eea6d93da90" acquired by "delete_volume" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:31 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6 Sep 25 10:42:31 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[928532a0-3dc1-41f7-9c78-55b1063f64b5]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:31 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90 Sep 25 10:42:31 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:32 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6" returned: 0 in 0.737s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:32 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90" returned: 0 in 0.506s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:32 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6 Sep 25 10:42:32 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:32 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90 Sep 25 10:42:32 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:32 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4194619b-c694-4498-a854-531c951895f6" returned: 0 in 0.405s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:32 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd45847e-fb8f-4309-9d53-2eea6d93da90" returned: 0 in 0.400s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-quobyte-4194619b-c694-4498-a854-531c951895f6" released by "delete_volume" :: held 1.251s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Lock "cinder-quobyte-bd45847e-fb8f-4309-9d53-2eea6d93da90" released by "delete_volume" :: held 0.987s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Created reservations ['4fc00dbb-096c-4885-8d9a-586f048becb5', '0656f72d-e84b-4679-bf33-ed437cbf48cf', '3e827104-c446-4d0b-9fca-a12bfa0510bf', 'f82f0cae-8aa2-4c72-853c-2a5b3c7247de'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Created reservations ['2abbfe77-ec15-4a94-a875-20abfad59c88', '371ca0e9-bba6-4b6f-8b31-80ecfe05c1cf', '490f57d9-ae64-4907-8c31-c80a4ceb288b', '9819ca8f-e9ce-43f2-8b87-1d5b0e246060'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:32 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:32 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:32 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:32 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:33 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.395s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:33 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Deleted volume successfully. Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7c4bcba7-522c-4c79-b08d-382a0f06dff4 tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-4194619b-c694-4498-a854-531c951895f6-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:33 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.494s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:33 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Deleted volume successfully. Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b79de1bb-a24d-4ba5-9cf0-e438ca3ab276 tempest-VolumesTransfersV355Test-828231760 None] Lock "cinder-bd45847e-fb8f-4309-9d53-2eea6d93da90-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "cinder-d96db0ca-93d0-4cf7-8757-7613a37eae25-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-d96db0ca-93d0-4cf7-8757-7613a37eae25-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "cinder-quobyte-d96db0ca-93d0-4cf7-8757-7613a37eae25" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-quobyte-d96db0ca-93d0-4cf7-8757-7613a37eae25" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ea361c-8ae1-4af2-947c-8cbba978aeb5]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:33 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25 Sep 25 10:42:33 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:34 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25" returned: 0 in 0.652s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:34 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25 Sep 25 10:42:34 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:34 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d96db0ca-93d0-4cf7-8757-7613a37eae25" returned: 0 in 0.429s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-quobyte-d96db0ca-93d0-4cf7-8757-7613a37eae25" released by "delete_volume" :: held 1.151s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:34 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Created reservations ['c4fa66df-6539-43d1-8abb-ac0bd6a58c39', 'df32fb2d-36e1-462c-8a9f-b0c7a39e74c4', 'bbbbc6d4-4a8b-4660-a017-9cea6118b315', '9897fb2a-a20b-4dd8-8c6e-d703135595d0'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:35 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:35 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:35 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.369s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:35 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Deleted volume successfully. Sep 25 10:42:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a5d0c7e3-fe68-4126-9bc8-6843ffa3bcf3 tempest-VolumesListTestJSON-1354762385 None] Lock "cinder-d96db0ca-93d0-4cf7-8757-7613a37eae25-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=173,cinder:SELECT=112,cinder:INSERT=36,cinder:DELETE=16 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=175,cinder:SELECT=129,cinder:INSERT=44,cinder:DELETE=15 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Flow 'volume_create_manager' (92fbaf77-233d-49b0-8265-559c189b8229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7b1102-d087-410f-9a48-f0f3a96f410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7b1102-d087-410f-9a48-f0f3a96f410f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1855867475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b01f0c9-573c-41a0-82b1-cd9280a71108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc375e034764c9e90a30ce9ce8e8e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:44Z,use_quota=True,user_id='f600e23dd51a4c8581b717f3f87f4313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e8ea43-3534-4530-b2f7-2b60ac933c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e8ea43-3534-4530-b2f7-2b60ac933c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ed220a-9dcf-4697-8988-49af9956c525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ed220a-9dcf-4697-8988-49af9956c525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b01f0c9-573c-41a0-82b1-cd9280a71108', 'volume_name': 'volume-6b01f0c9-573c-41a0-82b1-cd9280a71108', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9e8589-9cf3-4995-af1c-e0b7e726a812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9e8589-9cf3-4995-af1c-e0b7e726a812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdb91c9-3583-49bc-902d-f380ec10e77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:44 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Volume 6b01f0c9-573c-41a0-82b1-cd9280a71108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b01f0c9-573c-41a0-82b1-cd9280a71108', 'volume_size': 1} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1855867475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b01f0c9-573c-41a0-82b1-cd9280a71108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc375e034764c9e90a30ce9ce8e8e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:44Z,use_quota=True,user_id='f600e23dd51a4c8581b717f3f87f4313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Creating volume 6b01f0c9-573c-41a0-82b1-cd9280a71108 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:44 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:44 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108 1073741824 Sep 25 10:42:44 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:44 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108 1073741824" returned: 0 in 0.643s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:44 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108 Sep 25 10:42:44 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:45 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108" returned: 0 in 0.409s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdb91c9-3583-49bc-902d-f380ec10e77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b01f0c9-573c-41a0-82b1-cd9280a71108', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5a94b9-3ab1-4fbd-ba73-f812ec65b51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:45 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Volume volume-6b01f0c9-573c-41a0-82b1-cd9280a71108 (6b01f0c9-573c-41a0-82b1-cd9280a71108): created successfully Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5a94b9-3ab1-4fbd-ba73-f812ec65b51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Flow 'volume_create_manager' (92fbaf77-233d-49b0-8265-559c189b8229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:45 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-316e6758-c901-4976-a334-81381f408495 tempest-VolumesNegativeTest-955505534 None] Created volume successfully. Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Flow 'volume_create_manager' (1943f7c7-27a7-4e71-9ba9-4b2fc4193996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4991f026-5ba1-41d4-9426-8defd8009d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4991f026-5ba1-41d4-9426-8defd8009d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2088882582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a316d0-77bb-48e9-b589-274f231ec84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303ad528edbe42de940c29ab1eccbed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:46Z,use_quota=True,user_id='290e3adebafd4c7bb4b4cf42196fc3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8136b1-11c4-4b51-a4a7-1a134dcf2262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8136b1-11c4-4b51-a4a7-1a134dcf2262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bc8165-9ae5-4bb9-9400-9a57f4cfcea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:45 devstack cinder-volume[87242]: DEBUG cinder.image.glance [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Creating Keystone auth plugin from conf {{(pid=87242) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bc8165-9ae5-4bb9-9400-9a57f4cfcea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8a316d0-77bb-48e9-b589-274f231ec84c', 'volume_name': 'volume-b8a316d0-77bb-48e9-b589-274f231ec84c', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8067d8f8-bea0-4fb2-a652-157b7b874f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8067d8f8-bea0-4fb2-a652-157b7b874f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b596f2-e1ea-4d1a-9322-f4aad66cf4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:46 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Volume b8a316d0-77bb-48e9-b589-274f231ec84c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8a316d0-77bb-48e9-b589-274f231ec84c', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Trying to clone b8a316d0-77bb-48e9-b589-274f231ec84c from image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]). {{(pid=87242) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Flow 'volume_create_manager' (4654c105-1a5a-47d0-a04a-fd4d85f9708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169e8c8b-4739-424c-abc1-770d4ca28b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169e8c8b-4739-424c-abc1-770d4ca28b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1224786104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f872fa0c-8ce6-4577-9624-328b0b67953c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68dbde608ba442df8668105aa2303a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:46Z,use_quota=True,user_id='ca1e547fe05449e4a085e022a2c400c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bea3d8e-2141-4b55-a839-fd4b43cbcdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bea3d8e-2141-4b55-a839-fd4b43cbcdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88698ce4-59e7-4dcb-8c22-bd3e6cf3e826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.image.glance [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Creating Keystone auth plugin from conf {{(pid=87242) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:42:46 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Image download 20.69 MB at 20.69 MB/s Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2350f93b-623d-4c7c-bc98-27fc70b06d5f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:46 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD Sep 25 10:42:46 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88698ce4-59e7-4dcb-8c22-bd3e6cf3e826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f872fa0c-8ce6-4577-9624-328b0b67953c', 'volume_name': 'volume-f872fa0c-8ce6-4577-9624-328b0b67953c', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8f3887-4776-4b7f-9e0e-4331dc6d273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8f3887-4776-4b7f-9e0e-4331dc6d273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2173178-fbce-4309-a118-a2216eb8ab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:47 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Volume f872fa0c-8ce6-4577-9624-328b0b67953c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f872fa0c-8ce6-4577-9624-328b0b67953c', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Trying to clone f872fa0c-8ce6-4577-9624-328b0b67953c from image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]). {{(pid=87242) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:42:47 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Temporary image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c is fetched for user 290e3adebafd4c7bb4b4cf42196fc3f7. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9509e88-53a2-4ddf-8de9-823f38a94107]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:42:47 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Image download 20.69 MB at 20.69 MB/s Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40b65ae-2eee-4ad0-8617-7c511ce98fe6]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:47 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD Sep 25 10:42:47 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:47 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD Sep 25 10:42:47 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:48 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2088882582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a316d0-77bb-48e9-b589-274f231ec84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303ad528edbe42de940c29ab1eccbed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:46Z,use_quota=True,user_id='290e3adebafd4c7bb4b4cf42196fc3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Creating volume b8a316d0-77bb-48e9-b589-274f231ec84c {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:48 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:48 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c 1073741824 Sep 25 10:42:48 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:48 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD" returned: 0 in 0.612s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Temporary image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c is fetched for user ca1e547fe05449e4a085e022a2c400c7. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aa7692-1ee5-46a0-95de-44f1224e760f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:48 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD Sep 25 10:42:48 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:48 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c 1073741824" returned: 0 in 0.849s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:49 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:49 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:49 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:49 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c" returned: 0 in 0.341s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1224786104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f872fa0c-8ce6-4577-9624-328b0b67953c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68dbde608ba442df8668105aa2303a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:42:46Z,use_quota=True,user_id='ca1e547fe05449e4a085e022a2c400c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Creating volume f872fa0c-8ce6-4577-9624-328b0b67953c {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:42:49 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Attempting download of 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c ((None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}])) to volume b8a316d0-77bb-48e9-b589-274f231ec84c. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 10:42:49 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c 1073741824 Sep 25 10:42:49 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed44c6b-3404-4969-b1ed-e34267f694d8]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_eoeahlv3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:49 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_eoeahlv3 Sep 25 10:42:49 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:50 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_eoeahlv3" returned: 0 in 0.745s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_eoeahlv3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:50 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_eoeahlv3 Sep 25 10:42:50 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:50 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c 1073741824" returned: 0 in 1.301s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:50 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c Sep 25 10:42:50 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:51 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_eoeahlv3" returned: 1 in 0.696s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_eoeahlv3' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2932eb81-9bec-49d9-a2f8-fb355fbcbb81]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:51 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD Sep 25 10:42:51 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:51 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c" returned: 0 in 0.699s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Attempting download of 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c ((None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}])) to volume f872fa0c-8ce6-4577-9624-328b0b67953c. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e61b037-d057-43a6-90d0-e9bbffe6903e]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_sao0em2m {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:51 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c was qcow2, converting to qcow2 {{(pid=87242) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:42:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:51 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c Sep 25 10:42:51 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:51 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_sao0em2m Sep 25 10:42:51 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:52 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_sao0em2m" returned: 0 in 0.695s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_sao0em2m {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:52 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_sao0em2m Sep 25 10:42:52 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:52 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_sao0em2m" returned: 1 in 0.515s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_sao0em2m' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:42:52 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9881b667-d8be-4f35-b833-e2ebffbf50d0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:52 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD Sep 25 10:42:52 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:53 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:53 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c was qcow2, converting to qcow2 {{(pid=87242) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:42:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:53 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c Sep 25 10:42:53 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:54 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c" returned: 0 in 3.090s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:54 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_9c1zkbysdevstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:42:54 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Converted 112.00 MB image at 36.23 MB/s Sep 25 10:42:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:54 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c 1G Sep 25 10:42:54 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:55 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c 1G" returned: 0 in 0.508s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:55 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Downloaded image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c ((None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}])) to volume b8a316d0-77bb-48e9-b589-274f231ec84c successfully. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 10:42:55 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Temporary image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c for user 290e3adebafd4c7bb4b4cf42196fc3f7 is deleted. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:42:55 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Marking volume b8a316d0-77bb-48e9-b589-274f231ec84c as bootable. {{(pid=87242) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 10:42:55 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Copying metadata from image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c to b8a316d0-77bb-48e9-b589-274f231ec84c. {{(pid=87242) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:42:55 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Creating volume glance metadata for volume b8a316d0-77bb-48e9-b589-274f231ec84c backed by image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87242) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:42:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b596f2-e1ea-4d1a-9322-f4aad66cf4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a316d0-77bb-48e9-b589-274f231ec84c', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a015e455-103a-4253-814f-55c6fe388138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:55 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Volume volume-b8a316d0-77bb-48e9-b589-274f231ec84c (b8a316d0-77bb-48e9-b589-274f231ec84c): created successfully Sep 25 10:42:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a015e455-103a-4253-814f-55c6fe388138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Flow 'volume_create_manager' (1943f7c7-27a7-4e71-9ba9-4b2fc4193996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:55 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-49c0aa15-55f4-4c75-83bf-dd624327016c tempest-VolumesImageMetadata-1524974251 None] Created volume successfully. Sep 25 10:42:56 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c" returned: 0 in 3.321s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:56 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_u3gbg76kdevstack@QuobyteHD, size 112.00 MB, duration 3.33 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:42:56 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Converted 112.00 MB image at 33.64 MB/s Sep 25 10:42:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:56 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c 1G Sep 25 10:42:56 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Acquiring lock "cinder-b8a316d0-77bb-48e9-b589-274f231ec84c-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Lock "cinder-b8a316d0-77bb-48e9-b589-274f231ec84c-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:57 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c 1G" returned: 0 in 0.986s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Downloaded image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c ((None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}])) to volume f872fa0c-8ce6-4577-9624-328b0b67953c successfully. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Temporary image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c for user ca1e547fe05449e4a085e022a2c400c7 is deleted. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Marking volume f872fa0c-8ce6-4577-9624-328b0b67953c as bootable. {{(pid=87242) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Copying metadata from image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c to f872fa0c-8ce6-4577-9624-328b0b67953c. {{(pid=87242) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Creating volume glance metadata for volume f872fa0c-8ce6-4577-9624-328b0b67953c backed by image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87242) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Acquiring lock "cinder-quobyte-b8a316d0-77bb-48e9-b589-274f231ec84c" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Lock "cinder-quobyte-b8a316d0-77bb-48e9-b589-274f231ec84c" acquired by "delete_volume" :: waited 0.051s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afa6615-c014-4693-8a37-b1431fd6cbfe]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2173178-fbce-4309-a118-a2216eb8ab42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f872fa0c-8ce6-4577-9624-328b0b67953c', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d54323f-92f8-48aa-a221-2849fdb635d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:42:58 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Volume volume-f872fa0c-8ce6-4577-9624-328b0b67953c (f872fa0c-8ce6-4577-9624-328b0b67953c): created successfully Sep 25 10:42:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d54323f-92f8-48aa-a221-2849fdb635d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:42:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Flow 'volume_create_manager' (4654c105-1a5a-47d0-a04a-fd4d85f9708d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:42:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6b7b873e-4a2a-465e-81c8-db362c9a90cc tempest-VolumesExtendTest-239577704 None] Created volume successfully. Sep 25 10:42:58 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c Sep 25 10:42:58 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:58 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c" returned: 0 in 0.677s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:58 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c Sep 25 10:42:58 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:58 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8a316d0-77bb-48e9-b589-274f231ec84c" returned: 0 in 0.346s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Lock "cinder-quobyte-b8a316d0-77bb-48e9-b589-274f231ec84c" released by "delete_volume" :: held 1.117s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Created reservations ['b0e0e406-eaca-4c83-ae9a-ea13f1b23907', '70c40b78-60af-41f2-a3b4-089b01060e87', '7e0dfbb8-7708-4740-944b-a5eb0b538c9c', 'b2ea00bd-0d22-4557-9a31-5b0fd6a4cbfa'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f1e0e6d7-9d8e-4bf4-8c52-e36df29646c6 tempest-VolumesExtendTest-239577704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f1e0e6d7-9d8e-4bf4-8c52-e36df29646c6 tempest-VolumesExtendTest-239577704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c81159-e7d7-4d39-9e18-6b006876ddf4]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f1e0e6d7-9d8e-4bf4-8c52-e36df29646c6 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:42:59 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:42:59 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:59 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c Sep 25 10:42:59 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:42:59 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.466s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:42:59 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Deleted volume successfully. Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c0c14c9-05ab-46b3-8608-a7ff15d86532 tempest-VolumesImageMetadata-1524974251 None] Lock "cinder-b8a316d0-77bb-48e9-b589-274f231ec84c-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:42:59 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f1e0e6d7-9d8e-4bf4-8c52-e36df29646c6 tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c" returned: 0 in 0.769s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:42:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f1e0e6d7-9d8e-4bf4-8c52-e36df29646c6 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c 2G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f1e0e6d7-9d8e-4bf4-8c52-e36df29646c6 tempest-VolumesExtendTest-239577704 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c 2G" returned: 0 in 0.263s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f1e0e6d7-9d8e-4bf4-8c52-e36df29646c6 tempest-VolumesExtendTest-239577704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.078s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:00 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f1e0e6d7-9d8e-4bf4-8c52-e36df29646c6 tempest-VolumesExtendTest-239577704 None] Extend volume completed successfully. Sep 25 10:43:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Acquiring lock "cinder-f872fa0c-8ce6-4577-9624-328b0b67953c-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Lock "cinder-f872fa0c-8ce6-4577-9624-328b0b67953c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Acquiring lock "cinder-quobyte-f872fa0c-8ce6-4577-9624-328b0b67953c" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Lock "cinder-quobyte-f872fa0c-8ce6-4577-9624-328b0b67953c" acquired by "delete_volume" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:02 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f005db44-11a9-4664-810c-165949073aa2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:03 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c Sep 25 10:43:03 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:43:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:03 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:43:03 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:03 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c" returned: 0 in 0.756s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:03 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c Sep 25 10:43:03 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:04 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.538s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:43:04 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f872fa0c-8ce6-4577-9624-328b0b67953c" returned: 0 in 0.597s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Lock "cinder-quobyte-f872fa0c-8ce6-4577-9624-328b0b67953c" released by "delete_volume" :: held 1.435s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Created reservations ['547829d2-aab8-469c-8afd-1417d2553549', 'bd386c7d-b0e0-4ab0-a6f2-ee7e86a133a7', 'a12e24f1-d9fc-4bb2-816c-4b48547de4ef', 'f9993501-d305-4260-941b-71bcbbde3cc7'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:04 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:43:04 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:04 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.302s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Deleted volume successfully. Sep 25 10:43:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b6db46b4-14b4-4a4c-bef4-dbdedafa18f8 tempest-VolumesExtendTest-239577704 None] Lock "cinder-f872fa0c-8ce6-4577-9624-328b0b67953c-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Flow 'volume_create_manager' (eaee260c-0e09-4055-8a01-20348e6b36c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066548a4-96d6-4c01-b5f5-ffc93e3557fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066548a4-96d6-4c01-b5f5-ffc93e3557fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1289966610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6877b2f8-8958-4817-a45f-02bbf6ff1500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68dbde608ba442df8668105aa2303a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:06Z,use_quota=True,user_id='ca1e547fe05449e4a085e022a2c400c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47e8ab5-7c4b-426a-b194-3775d74c05ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47e8ab5-7c4b-426a-b194-3775d74c05ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6742bd3-c87d-44c9-91b0-1197aac848bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6742bd3-c87d-44c9-91b0-1197aac848bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6877b2f8-8958-4817-a45f-02bbf6ff1500', 'volume_name': 'volume-6877b2f8-8958-4817-a45f-02bbf6ff1500', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b505a6-14be-4965-91c5-7724d1d32137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b505a6-14be-4965-91c5-7724d1d32137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a2fc5e-d15f-40bf-8c39-f5a0cad80cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:05 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Volume 6877b2f8-8958-4817-a45f-02bbf6ff1500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6877b2f8-8958-4817-a45f-02bbf6ff1500', 'volume_size': 1} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1289966610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6877b2f8-8958-4817-a45f-02bbf6ff1500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68dbde608ba442df8668105aa2303a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:06Z,use_quota=True,user_id='ca1e547fe05449e4a085e022a2c400c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Creating volume 6877b2f8-8958-4817-a45f-02bbf6ff1500 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:43:05 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:43:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:05 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 1073741824 Sep 25 10:43:05 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:06 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 1073741824" returned: 0 in 0.582s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:06 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 Sep 25 10:43:06 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:06 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500" returned: 0 in 0.443s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:43:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a2fc5e-d15f-40bf-8c39-f5a0cad80cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6877b2f8-8958-4817-a45f-02bbf6ff1500', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad733801-8824-40fe-94cb-b0839ad27cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:06 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Volume volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 (6877b2f8-8958-4817-a45f-02bbf6ff1500): created successfully Sep 25 10:43:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad733801-8824-40fe-94cb-b0839ad27cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Flow 'volume_create_manager' (eaee260c-0e09-4055-8a01-20348e6b36c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:06 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d43093d5-8e8e-491e-a140-bede274a5d57 tempest-VolumesExtendTest-239577704 None] Created volume successfully. Sep 25 10:43:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Creating offline snapshot e6eac490-a96a-44c3-926d-32d95156eed5 of volume 6877b2f8-8958-4817-a45f-02bbf6ff1500 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:43:08 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e271e77-dc19-40e5-a9e6-7e0623606025]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:08 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 Sep 25 10:43:08 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:08 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500" returned: 0 in 0.579s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:08 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 1G Sep 25 10:43:08 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:09 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 1G" returned: 0 in 0.633s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:09 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 Sep 25 10:43:09 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:09 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5" returned: 0 in 0.468s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:09 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 is being set with open permissions: ugo+rw Sep 25 10:43:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:09 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 Sep 25 10:43:09 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:10 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5" returned: 0 in 0.345s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:10 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.info Sep 25 10:43:10 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:10 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.info" returned: 0 in 0.422s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:10 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.info is being set with open permissions: ugo+rw Sep 25 10:43:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:10 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.info Sep 25 10:43:10 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:10 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.info" returned: 0 in 0.284s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.879s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:10 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-95b2ed72-eb36-4d0a-9c5a-8c3423b31c5d tempest-VolumesExtendTest-239577704 None] Create snapshot completed successfully Sep 25 10:43:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1e82ccf-125a-4ca6-abde-7c9847131de4 tempest-VolumesExtendTest-239577704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1e82ccf-125a-4ca6-abde-7c9847131de4 tempest-VolumesExtendTest-239577704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:11 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[81754d8d-5e40-4c46-aca5-ad399a3c9045]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1e82ccf-125a-4ca6-abde-7c9847131de4 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:11 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 Sep 25 10:43:11 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:12 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1e82ccf-125a-4ca6-abde-7c9847131de4 tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500" returned: 0 in 0.682s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1e82ccf-125a-4ca6-abde-7c9847131de4 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 2G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1e82ccf-125a-4ca6-abde-7c9847131de4 tempest-VolumesExtendTest-239577704 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 2G" returned: 0 in 0.299s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1e82ccf-125a-4ca6-abde-7c9847131de4 tempest-VolumesExtendTest-239577704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.054s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:12 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a1e82ccf-125a-4ca6-abde-7c9847131de4 tempest-VolumesExtendTest-239577704 None] Extend volume completed successfully. Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Flow 'volume_create_manager' (808106cb-e506-4846-961a-db54e657d433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b875411d-4f90-4ae0-ae60-f9ed9f0aa84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b875411d-4f90-4ae0-ae60-f9ed9f0aa84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1104037220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b393539c-4b7e-4d50-8bc2-4e6fc6d76e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ff6e6377e44af49b4579b5c2a6be4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:14Z,use_quota=True,user_id='5a6ced372b334c4989f1fc827a82dafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c7bbe1-c5e9-433f-8f24-ccb54ce01795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c7bbe1-c5e9-433f-8f24-ccb54ce01795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5338b0d5-3256-4aca-8b91-84fc4d27cf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5338b0d5-3256-4aca-8b91-84fc4d27cf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b393539c-4b7e-4d50-8bc2-4e6fc6d76e44', 'volume_name': 'volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9c5a2a-dcd7-4544-9674-9381068605e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9c5a2a-dcd7-4544-9674-9381068605e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f6eaea-054e-4051-ac0c-9ac4e1331fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:13 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Volume b393539c-4b7e-4d50-8bc2-4e6fc6d76e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44', 'volume_size': 1} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1104037220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b393539c-4b7e-4d50-8bc2-4e6fc6d76e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ff6e6377e44af49b4579b5c2a6be4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:14Z,use_quota=True,user_id='5a6ced372b334c4989f1fc827a82dafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Creating volume b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:43:13 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Acquiring lock "cinder-e6eac490-a96a-44c3-926d-32d95156eed5-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Lock "cinder-e6eac490-a96a-44c3-926d-32d95156eed5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:13 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 1073741824 Sep 25 10:43:13 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Acquiring lock "cinder-quobyte-6877b2f8-8958-4817-a45f-02bbf6ff1500" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Lock "cinder-quobyte-6877b2f8-8958-4817-a45f-02bbf6ff1500" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Acquiring lock "cinder-quobyte-e6eac490-a96a-44c3-926d-32d95156eed5" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Lock "cinder-quobyte-e6eac490-a96a-44c3-926d-32d95156eed5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Deleting offline snapshot e6eac490-a96a-44c3-926d-32d95156eed5 of volume 6877b2f8-8958-4817-a45f-02bbf6ff1500 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] snapshot_file for this snap is: volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf26043-3fa8-4cb1-8d75-b03775cd068b]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:14 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 Sep 25 10:43:14 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:14 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5" returned: 0 in 0.619s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6877b2f8-8958-4817-a45f-02bbf6ff1500(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:43:14 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:14 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[54789d73-4477-4443-b8bb-20783dbc8ae8]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 1073741824" returned: 0 in 0.870s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:14 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 Sep 25 10:43:14 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:14 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 Sep 25 10:43:14 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:15 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44" returned: 0 in 0.390s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f6eaea-054e-4051-ac0c-9ac4e1331fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403a3b50-d849-46d5-8184-a5bfd8ffb33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:15 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Volume volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 (b393539c-4b7e-4d50-8bc2-4e6fc6d76e44): created successfully Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403a3b50-d849-46d5-8184-a5bfd8ffb33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Flow 'volume_create_manager' (808106cb-e506-4846-961a-db54e657d433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:15 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e2e51e87-a06a-424e-b6b4-bd5f373194aa tempest-VolumesTransfersTest-2070675966 None] Created volume successfully. Sep 25 10:43:15 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500" returned: 0 in 0.630s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:15 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 Sep 25 10:43:15 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:15 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5" returned: 0 in 0.593s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Acquiring lock "cinder-6b01f0c9-573c-41a0-82b1-cd9280a71108-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:15 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5 Sep 25 10:43:15 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Lock "cinder-6b01f0c9-573c-41a0-82b1-cd9280a71108-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Acquiring lock "cinder-quobyte-6b01f0c9-573c-41a0-82b1-cd9280a71108" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Lock "cinder-quobyte-6b01f0c9-573c-41a0-82b1-cd9280a71108" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:16 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7f6389-844b-4650-a2d7-987f1cf40e51]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:16 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108 Sep 25 10:43:16 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:16 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500.e6eac490-a96a-44c3-926d-32d95156eed5" returned: 0 in 0.408s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Lock "cinder-quobyte-e6eac490-a96a-44c3-926d-32d95156eed5" released by "_delete_snapshot" :: held 2.480s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Lock "cinder-quobyte-6877b2f8-8958-4817-a45f-02bbf6ff1500" released by "delete_snapshot" :: held 2.516s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:16 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Created reservations ['29d0627d-1cc0-40ff-a32a-7e55689800c4', 'ea4f57e3-1d44-4116-8fb6-b915ff1bd3b4', '3276f725-4f46-4729-911b-df3b3da6da88', 'fd98c3b6-8201-4731-a46a-b1cff5bfd49a'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Delete snapshot completed successfully. Sep 25 10:43:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-079f7b3f-f66c-467a-b232-f1a02e0698b1 tempest-VolumesExtendTest-239577704 None] Lock "cinder-e6eac490-a96a-44c3-926d-32d95156eed5-delete_snapshot" released by "delete_snapshot" :: held 2.729s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:16 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108" returned: 0 in 0.574s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:16 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108 Sep 25 10:43:16 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-94b24ac0-cb66-490f-bd8d-c40ec20a2b04 tempest-VolumesTransfersTest-1151834659 None] Transfer volume completed successfully. Sep 25 10:43:17 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6b01f0c9-573c-41a0-82b1-cd9280a71108" returned: 0 in 0.365s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Lock "cinder-quobyte-6b01f0c9-573c-41a0-82b1-cd9280a71108" released by "delete_volume" :: held 1.047s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Created reservations ['b45f58be-4c9e-483c-a993-7c7d034c1e67', 'db2964c2-0cbf-4966-9f50-d8e36dcb4018', '2c00f45f-2f20-4157-8c5f-d867969628fd', 'a571a1a3-5f05-41ae-98f5-f9939fc8b84e'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Acquiring lock "cinder-6877b2f8-8958-4817-a45f-02bbf6ff1500-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:17 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:43:17 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Lock "cinder-6877b2f8-8958-4817-a45f-02bbf6ff1500-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Acquiring lock "cinder-quobyte-6877b2f8-8958-4817-a45f-02bbf6ff1500" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Lock "cinder-quobyte-6877b2f8-8958-4817-a45f-02bbf6ff1500" acquired by "delete_volume" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c482d-e33c-46c6-a7d5-ade38f281ebf]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:17 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 Sep 25 10:43:17 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:17 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.433s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Deleted volume successfully. Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-727f8acd-843d-4f6d-a9d6-4288f75f4a4f tempest-VolumesNegativeTest-955505534 None] Lock "cinder-6b01f0c9-573c-41a0-82b1-cd9280a71108-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Acquiring lock "cinder-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Lock "cinder-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Acquiring lock "cinder-quobyte-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Lock "cinder-quobyte-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[322d5725-5f46-470b-9fd5-0fd654ce0c46]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:18 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500" returned: 0 in 0.536s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:18 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500 Sep 25 10:43:18 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:18 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 Sep 25 10:43:18 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:18 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6877b2f8-8958-4817-a45f-02bbf6ff1500" returned: 0 in 0.319s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Lock "cinder-quobyte-6877b2f8-8958-4817-a45f-02bbf6ff1500" released by "delete_volume" :: held 0.957s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Created reservations ['0635c203-d4e5-4053-beb0-e4c7e1f4fc1d', 'bccb63c4-b224-4352-8305-ca5966e41f78', '2edef1e8-7da6-46d9-9919-4d5e314bb268', '7c41330e-7890-4de2-b6cb-9f8bd8fc75db'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:18 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44" returned: 0 in 0.507s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:18 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44 Sep 25 10:43:18 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:18 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:43:18 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:18 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44" returned: 0 in 0.305s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Lock "cinder-quobyte-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44" released by "delete_volume" :: held 0.867s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Created reservations ['3cbfc1b0-f3a8-4e73-8e35-12d0658d6a2d', '25710180-815c-4563-beaa-3acacc8a16cc', '64dee3a2-f460-4872-9cf5-9e0a305a688e', 'c053ff2a-7ebd-47a7-b0ee-bfb2df65bb00'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:18 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.301s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:18 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Deleted volume successfully. Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-44e041f8-c5fc-41a3-bddb-67be132269e9 tempest-VolumesExtendTest-239577704 None] Lock "cinder-6877b2f8-8958-4817-a45f-02bbf6ff1500-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:19 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:43:19 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:19 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.332s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:19 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Deleted volume successfully. Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-993ee11b-a934-42c1-8272-971d8cae5226 tempest-VolumesTransfersTest-266680775 None] Lock "cinder-b393539c-4b7e-4d50-8bc2-4e6fc6d76e44-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Flow 'volume_create_manager' (2c28c27c-3b43-4f82-a07b-fe8162e1cd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413614a4-d5f3-4159-a9a3-6110c0352c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413614a4-d5f3-4159-a9a3-6110c0352c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1952819401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167bd6d3-d025-41e8-b24b-02af6e5300bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ff6e6377e44af49b4579b5c2a6be4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:20Z,use_quota=True,user_id='5a6ced372b334c4989f1fc827a82dafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc0441d-f905-4d6f-b603-a0c57ffaafde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc0441d-f905-4d6f-b603-a0c57ffaafde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd7667c-8f65-4993-b5ab-f77766af8d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd7667c-8f65-4993-b5ab-f77766af8d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '167bd6d3-d025-41e8-b24b-02af6e5300bd', 'volume_name': 'volume-167bd6d3-d025-41e8-b24b-02af6e5300bd', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684d9e8c-d18e-4fdc-b390-bc471ed1336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684d9e8c-d18e-4fdc-b390-bc471ed1336d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa41313-43cc-4879-9fc0-2b0345df0b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:19 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Volume 167bd6d3-d025-41e8-b24b-02af6e5300bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-167bd6d3-d025-41e8-b24b-02af6e5300bd', 'volume_size': 1} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1952819401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167bd6d3-d025-41e8-b24b-02af6e5300bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ff6e6377e44af49b4579b5c2a6be4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:20Z,use_quota=True,user_id='5a6ced372b334c4989f1fc827a82dafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Creating volume 167bd6d3-d025-41e8-b24b-02af6e5300bd {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:43:19 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:43:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:19 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd 1073741824 Sep 25 10:43:19 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:20 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd 1073741824" returned: 0 in 0.575s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:20 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd Sep 25 10:43:20 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:20 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd" returned: 0 in 0.369s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:43:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa41313-43cc-4879-9fc0-2b0345df0b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167bd6d3-d025-41e8-b24b-02af6e5300bd', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e626a42e-4b09-4ec1-a138-6894dc52bb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:20 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Volume volume-167bd6d3-d025-41e8-b24b-02af6e5300bd (167bd6d3-d025-41e8-b24b-02af6e5300bd): created successfully Sep 25 10:43:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e626a42e-4b09-4ec1-a138-6894dc52bb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Flow 'volume_create_manager' (2c28c27c-3b43-4f82-a07b-fe8162e1cd37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3133be26-bbcb-4a39-89e3-1fbeec2b045d tempest-VolumesTransfersTest-2070675966 None] Created volume successfully. Sep 25 10:43:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Acquiring lock "cinder-167bd6d3-d025-41e8-b24b-02af6e5300bd-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Lock "cinder-167bd6d3-d025-41e8-b24b-02af6e5300bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Acquiring lock "cinder-quobyte-167bd6d3-d025-41e8-b24b-02af6e5300bd" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Lock "cinder-quobyte-167bd6d3-d025-41e8-b24b-02af6e5300bd" acquired by "delete_volume" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:22 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0168a57c-a99c-4deb-ad7e-10c09f4097ee]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:22 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd Sep 25 10:43:22 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:22 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd" returned: 0 in 0.534s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:22 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd Sep 25 10:43:22 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:23 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-167bd6d3-d025-41e8-b24b-02af6e5300bd" returned: 0 in 0.348s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Lock "cinder-quobyte-167bd6d3-d025-41e8-b24b-02af6e5300bd" released by "delete_volume" :: held 0.954s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Created reservations ['7da0f8f1-c4c4-49fd-96c3-7f7a6686f506', 'd383924e-9dac-4382-8d65-050797425b50', 'c112c7d3-c42a-401a-bd26-0922906eb73b', '52acde8c-59c6-441c-87fa-b032e42619d0'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:23 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:43:23 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:23 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.307s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Deleted volume successfully. Sep 25 10:43:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d8d061e7-94a3-48b2-b28a-f80af913f12d tempest-VolumesTransfersTest-266680775 None] Lock "cinder-167bd6d3-d025-41e8-b24b-02af6e5300bd-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (4c39ab41-7342-49f6-9373-6607fa8c2d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5496f060-ceef-435d-a838-1ec15cf7df40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5496f060-ceef-435d-a838-1ec15cf7df40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1525617387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1666eb7-3b26-4add-8f7b-b07df135c2f3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:24Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2566a7c9-786f-455b-bc39-2d5392d257e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2566a7c9-786f-455b-bc39-2d5392d257e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c77e61-b6c8-420d-891a-3054267ae28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c77e61-b6c8-420d-891a-3054267ae28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1666eb7-3b26-4add-8f7b-b07df135c2f3', 'volume_name': 'volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed2a9c0-4598-4dee-9f63-beb835e0c8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed2a9c0-4598-4dee-9f63-beb835e0c8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a4d43e-ddcf-48a5-917e-7ba3fcaa21e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:24 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Volume b1666eb7-3b26-4add-8f7b-b07df135c2f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3', 'volume_size': 1} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1525617387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1666eb7-3b26-4add-8f7b-b07df135c2f3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:24Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Creating volume b1666eb7-3b26-4add-8f7b-b07df135c2f3 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:43:24 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:43:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:24 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3 1073741824 Sep 25 10:43:24 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:25 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3 1073741824" returned: 0 in 0.591s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:25 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3 Sep 25 10:43:25 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:25 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3" returned: 0 in 0.360s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:43:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a4d43e-ddcf-48a5-917e-7ba3fcaa21e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c8844e-c4c3-4094-b8a8-085dbaf404f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:25 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Volume volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3 (b1666eb7-3b26-4add-8f7b-b07df135c2f3): created successfully Sep 25 10:43:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c8844e-c4c3-4094-b8a8-085dbaf404f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (4c39ab41-7342-49f6-9373-6607fa8c2d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:25 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b5a19329-629f-4695-9c6a-38120f3d6e5e tempest-VolumesGetTest-1991319628 None] Created volume successfully. Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (e29c2356-9def-4631-b62b-a1b90200691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3510c6f-7f11-4681-8f95-994c7d98a37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3510c6f-7f11-4681-8f95-994c7d98a37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1006930609',display_name='tempest-VolumesGetTest-Volume-233300085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f989f7e-838c-4712-be7f-ec1795be8532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:28Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea49348-2efd-4234-9a41-e5ff347d5e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea49348-2efd-4234-9a41-e5ff347d5e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe31c1c-82af-4ea3-a3df-2055355c7af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe31c1c-82af-4ea3-a3df-2055355c7af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f989f7e-838c-4712-be7f-ec1795be8532', 'volume_name': 'volume-0f989f7e-838c-4712-be7f-ec1795be8532', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b1be85-c0d4-42c7-9853-8423181e3a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b1be85-c0d4-42c7-9853-8423181e3a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d76c18-a42a-4eb7-9e93-5ad7e9531532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:28 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Volume 0f989f7e-838c-4712-be7f-ec1795be8532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f989f7e-838c-4712-be7f-ec1795be8532', 'volume_size': 1} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1006930609',display_name='tempest-VolumesGetTest-Volume-233300085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f989f7e-838c-4712-be7f-ec1795be8532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:28Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Creating volume 0f989f7e-838c-4712-be7f-ec1795be8532 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:43:28 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:43:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:28 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532 1073741824 Sep 25 10:43:28 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:29 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532 1073741824" returned: 0 in 0.621s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:29 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532 Sep 25 10:43:29 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:29 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532" returned: 0 in 0.430s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:43:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d76c18-a42a-4eb7-9e93-5ad7e9531532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f989f7e-838c-4712-be7f-ec1795be8532', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c2af34-e533-40b9-be96-8e700660e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:29 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Volume volume-0f989f7e-838c-4712-be7f-ec1795be8532 (0f989f7e-838c-4712-be7f-ec1795be8532): created successfully Sep 25 10:43:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c2af34-e533-40b9-be96-8e700660e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (e29c2356-9def-4631-b62b-a1b90200691f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:29 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5b705f02-a15c-4fb8-b087-bc016320d1b8 tempest-VolumesGetTest-1991319628 None] Created volume successfully. Sep 25 10:43:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-0f989f7e-838c-4712-be7f-ec1795be8532-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Lock "cinder-0f989f7e-838c-4712-be7f-ec1795be8532-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-quobyte-0f989f7e-838c-4712-be7f-ec1795be8532" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-0f989f7e-838c-4712-be7f-ec1795be8532" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:30 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c2a9c8-8b50-4d2e-a1fd-f9a3be694b39]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:31 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532 Sep 25 10:43:31 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:31 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532" returned: 0 in 0.536s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:31 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532 Sep 25 10:43:31 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:31 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f989f7e-838c-4712-be7f-ec1795be8532" returned: 0 in 0.342s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-0f989f7e-838c-4712-be7f-ec1795be8532" released by "delete_volume" :: held 0.945s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Created reservations ['8ff04cd1-30ac-4af1-921c-c275fc93de8c', '98e54f3b-2893-47b0-877a-160697d83614', '406d9f39-f2ba-469b-9703-4841d338958d', '5b440b43-f9ac-4469-aa9e-a13dd0e9f8a1'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:32 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:43:32 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:32 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.374s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:32 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:32 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Deleted volume successfully. Sep 25 10:43:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6452f4af-8fc9-4e41-9cf1-ddde7ecc3349 tempest-VolumesGetTest-1991319628 None] Lock "cinder-0f989f7e-838c-4712-be7f-ec1795be8532-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-b1666eb7-3b26-4add-8f7b-b07df135c2f3-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Lock "cinder-b1666eb7-3b26-4add-8f7b-b07df135c2f3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-quobyte-b1666eb7-3b26-4add-8f7b-b07df135c2f3" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-b1666eb7-3b26-4add-8f7b-b07df135c2f3" acquired by "delete_volume" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:33 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac2ed74-f8ac-4a76-9951-872221fc0527]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:33 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3 Sep 25 10:43:33 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:34 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3" returned: 0 in 0.827s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:34 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3 Sep 25 10:43:34 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:34 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1666eb7-3b26-4add-8f7b-b07df135c2f3" returned: 0 in 0.400s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-b1666eb7-3b26-4add-8f7b-b07df135c2f3" released by "delete_volume" :: held 1.302s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Created reservations ['2b39b6e5-b359-42c6-b3ce-41ac7b4661fd', 'f34a5ae1-0726-4d74-a79e-b8ce2e67f529', '58ae4ede-f514-4b51-b749-bf56e633af95', 'b1dd46b1-0c35-4790-a620-a0305ce6306b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:34 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:43:34 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-16823416-478c-40d6-8e1d-752fd9a1415d req-246b7235-6483-4cb0-944a-2dac5baf46cf tempest-TestMinimumBasicScenario-1809780170 None] Terminate volume connection completed successfully. Sep 25 10:43:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-16823416-478c-40d6-8e1d-752fd9a1415d req-246b7235-6483-4cb0-944a-2dac5baf46cf tempest-TestMinimumBasicScenario-1809780170 None] Deleting attachment 7c4639fa-0ba4-42a9-aa81-0f113cfe3a8c. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:43:35 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.600s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:35 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Deleted volume successfully. Sep 25 10:43:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1354dfe2-e885-4044-8a76-cb8e66a5f3b4 tempest-VolumesGetTest-1991319628 None] Lock "cinder-b1666eb7-3b26-4add-8f7b-b07df135c2f3-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (11114af5-46f9-4be5-94f5-a83b206a51aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3299456b-e304-4fbe-9bab-ae452d91f884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3299456b-e304-4fbe-9bab-ae452d91f884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-435813471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:37Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78bf1b7-21d3-40ac-99c7-a0c1663af682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78bf1b7-21d3-40ac-99c7-a0c1663af682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5effec-e040-40e6-9832-b3202bfba267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5effec-e040-40e6-9832-b3202bfba267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b', 'volume_name': 'volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e69d2a-bcf3-4c05-86e2-4c6752944b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e69d2a-bcf3-4c05-86e2-4c6752944b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40504ba-d6d8-4b09-aacb-22f8af7af959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:36 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Volume 6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b', 'volume_size': 1} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-435813471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:37Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Creating volume 6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:43:36 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:36 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b 1073741824 Sep 25 10:43:36 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Acquiring lock "cinder-bd24276c-bf16-4c9b-815e-71ecc4a8646c-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Lock "cinder-bd24276c-bf16-4c9b-815e-71ecc4a8646c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Acquiring lock "cinder-quobyte-bd24276c-bf16-4c9b-815e-71ecc4a8646c" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Lock "cinder-quobyte-bd24276c-bf16-4c9b-815e-71ecc4a8646c" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:37 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92c0a50-7c4e-4d13-95b9-feeadacff5b4]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:37 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c Sep 25 10:43:37 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:37 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b 1073741824" returned: 0 in 0.830s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:37 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b Sep 25 10:43:37 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:37 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c" returned: 0 in 0.668s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:37 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c Sep 25 10:43:37 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:38 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b" returned: 0 in 0.338s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40504ba-d6d8-4b09-aacb-22f8af7af959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bb2150-2285-4670-bc92-7da604675014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:38 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Volume volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b (6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b): created successfully Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bb2150-2285-4670-bc92-7da604675014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (11114af5-46f9-4be5-94f5-a83b206a51aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:38 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a18494c1-97e2-4658-8b87-930405dffaae tempest-VolumesGetTest-1991319628 None] Created volume successfully. Sep 25 10:43:38 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bd24276c-bf16-4c9b-815e-71ecc4a8646c" returned: 0 in 0.351s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Lock "cinder-quobyte-bd24276c-bf16-4c9b-815e-71ecc4a8646c" released by "delete_volume" :: held 1.108s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Created reservations ['ae1e4956-217f-4761-b935-be8e873ab60f', '661e2b35-a682-4410-8aa8-40fb35421d71', '6f889896-dc2e-4707-bce3-3a4d9e58974c', 'c5411266-3467-4986-86f9-6c55ac66797f'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:38 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:43:38 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:38 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.465s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:43:38 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Deleted volume successfully. Sep 25 10:43:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a89ae554-c2e7-4ee3-be8d-b1e38f7c3e4a tempest-TestMinimumBasicScenario-1809780170 None] Lock "cinder-bd24276c-bf16-4c9b-815e-71ecc4a8646c-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Flow 'volume_create_manager' (5695ed3e-23cb-4eb7-a252-2848b248d6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688153d5-d632-46e2-9b07-8b1ce6dec0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688153d5-d632-46e2-9b07-8b1ce6dec0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1621434635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63541436-c73a-4874-abbc-f73769eea02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888fb91633114569ac179276ed29670a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:39Z,use_quota=True,user_id='4f1f8c51f8a444a1a016088efeea5f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661a19a7-5fb3-4669-8586-317efb6d0852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661a19a7-5fb3-4669-8586-317efb6d0852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f879cc9-ff55-4839-8a2a-5ee57c0d5a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f879cc9-ff55-4839-8a2a-5ee57c0d5a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63541436-c73a-4874-abbc-f73769eea02a', 'volume_name': 'volume-63541436-c73a-4874-abbc-f73769eea02a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560ce3cb-58a6-4acb-a212-cf1e25932590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560ce3cb-58a6-4acb-a212-cf1e25932590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8297ae75-6571-415a-b127-2de7034de7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:39 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Volume 63541436-c73a-4874-abbc-f73769eea02a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63541436-c73a-4874-abbc-f73769eea02a', 'volume_size': 1} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1621434635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63541436-c73a-4874-abbc-f73769eea02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888fb91633114569ac179276ed29670a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:39Z,use_quota=True,user_id='4f1f8c51f8a444a1a016088efeea5f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Creating volume 63541436-c73a-4874-abbc-f73769eea02a {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:43:39 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:39 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a 1073741824 Sep 25 10:43:39 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (afa22bdc-63f4-4e25-a772-fecb05750ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cfdb47-da4b-4ced-a820-343cfa6ed1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cfdb47-da4b-4ced-a820-343cfa6ed1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2002734365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4117736c-31a1-4ba3-bdd3-c8d426fff8f9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:40Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684717d9-fbe0-4baa-b8dd-7b43c7484f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684717d9-fbe0-4baa-b8dd-7b43c7484f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5c2884-fa99-4fa1-8832-fe1af058eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5c2884-fa99-4fa1-8832-fe1af058eea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4117736c-31a1-4ba3-bdd3-c8d426fff8f9', 'volume_name': 'volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9', 'volume_size': 1, 'source_volid': '6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b', 'source_volstatus': 'available'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500a6509-aa19-4839-af61-66dcf83ae9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500a6509-aa19-4839-af61-66dcf83ae9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8f6f91-f531-4532-9142-51cd732158a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:39 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Volume 4117736c-31a1-4ba3-bdd3-c8d426fff8f9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9', 'volume_size': 1, 'source_volid': '6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b', 'source_volstatus': 'available'} Sep 25 10:43:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:40 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a 1073741824" returned: 0 in 0.928s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:40 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a Sep 25 10:43:40 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:41 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a" returned: 0 in 0.610s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.306s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:41 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Cloning volume 6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b to volume 4117736c-31a1-4ba3-bdd3-c8d426fff8f9 Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8297ae75-6571-415a-b127-2de7034de7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63541436-c73a-4874-abbc-f73769eea02a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bcba26-afa8-46c5-8746-701be70d8ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:41 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Volume volume-63541436-c73a-4874-abbc-f73769eea02a (63541436-c73a-4874-abbc-f73769eea02a): created successfully Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bcba26-afa8-46c5-8746-701be70d8ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Flow 'volume_create_manager' (5695ed3e-23cb-4eb7-a252-2848b248d6af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Creating offline snapshot dfaefd47-1cec-4a56-be87-4bc6678bc0c9 of volume 6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:43:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-05ca870e-4bcc-4162-ab96-4df74d32a7b0 tempest-VolumesSnapshotTestJSON-812185311 None] Created volume successfully. Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5046e166-f891-4848-88df-7d684da553f7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:41 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b Sep 25 10:43:41 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:41 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b" returned: 0 in 0.668s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:42 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 1G Sep 25 10:43:42 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Flow 'volume_create_manager' (a98e1d10-15a2-4abb-81ca-0746fe5d4b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec23f6c0-d679-430c-bcd2-652015b95a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec23f6c0-d679-430c-bcd2-652015b95a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-172735041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a477621-f2ac-42fb-8638-ab701bb410ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fa8ed7c1fb46a690a440bd4b477c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:43Z,use_quota=True,user_id='e85927ec3fc8462f92402af7f456d03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ac490b-f9fb-4f80-b70a-baf915bf2862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ac490b-f9fb-4f80-b70a-baf915bf2862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d62c5b-8922-41a7-be51-a321f4761599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d62c5b-8922-41a7-be51-a321f4761599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a477621-f2ac-42fb-8638-ab701bb410ef', 'volume_name': 'volume-0a477621-f2ac-42fb-8638-ab701bb410ef', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551b4f25-85ff-49ba-b683-5cae18a742a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551b4f25-85ff-49ba-b683-5cae18a742a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bc25fe-a11d-4c9b-a051-ddedcb6b8187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:42 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Volume 0a477621-f2ac-42fb-8638-ab701bb410ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a477621-f2ac-42fb-8638-ab701bb410ef', 'volume_size': 1} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:42 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 1G" returned: 0 in 0.840s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:42 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 Sep 25 10:43:42 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:43 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9" returned: 0 in 0.524s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:43 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 is being set with open permissions: ugo+rw Sep 25 10:43:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:43 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 Sep 25 10:43:43 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:43 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9" returned: 0 in 0.276s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:43 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.info Sep 25 10:43:43 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:43 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.info" returned: 0 in 0.300s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:43 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.info is being set with open permissions: ugo+rw Sep 25 10:43:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:44 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.info Sep 25 10:43:44 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:44 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.info" returned: 0 in 0.290s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-quobyte-4117736c-31a1-4ba3-bdd3-c8d426fff8f9" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-4117736c-31a1-4ba3-bdd3-c8d426fff8f9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] snapshot: dfaefd47-1cec-4a56-be87-4bc6678bc0c9, volume: 4117736c-31a1-4ba3-bdd3-c8d426fff8f9, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d383e3-8d86-4851-a341-45bd0025c980]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:44 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 Sep 25 10:43:44 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:44 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9" returned: 0 in 0.527s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4def7f0-8577-4d19-8c8a-f809dbc66d29]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:45 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b Sep 25 10:43:45 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:45 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b" returned: 0 in 0.437s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:43:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:43:45 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:43:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:45 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 Sep 25 10:43:45 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:53 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=95,cinder:INSERT=39,cinder:UPDATE=112,cinder:DELETE=12 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:43:53 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=125,cinder:SELECT=102,cinder:INSERT=40,cinder:DELETE=8 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:43:53 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9" returned: 0 in 8.570s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:53 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:43:53 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Converted 1024.00 MB image at 119.45 MB/s Sep 25 10:43:53 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 is being set with open permissions: ugo+rw Sep 25 10:43:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:53 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 Sep 25 10:43:53 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:54 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9" returned: 0 in 0.297s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-4117736c-31a1-4ba3-bdd3-c8d426fff8f9" released by "_copy_volume_from_snapshot" :: held 9.945s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-quobyte-dfaefd47-1cec-4a56-be87-4bc6678bc0c9" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-dfaefd47-1cec-4a56-be87-4bc6678bc0c9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Deleting offline snapshot dfaefd47-1cec-4a56-be87-4bc6678bc0c9 of volume 6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] snapshot_file for this snap is: volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb87dcac-c7c0-44f7-8c07-0e7bd5c3e9dd]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:54 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 Sep 25 10:43:54 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:54 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9" returned: 0 in 0.421s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baa5d7e-26e3-49aa-8a12-b2719d416ab9]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:54 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b Sep 25 10:43:54 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:55 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b" returned: 0 in 0.604s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:55 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 Sep 25 10:43:55 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:55 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9" returned: 0 in 0.400s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:55 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9 Sep 25 10:43:55 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:56 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b.dfaefd47-1cec-4a56-be87-4bc6678bc0c9" returned: 0 in 0.402s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-dfaefd47-1cec-4a56-be87-4bc6678bc0c9" released by "_delete_snapshot" :: held 1.993s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.190s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.554s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-172735041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a477621-f2ac-42fb-8638-ab701bb410ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fa8ed7c1fb46a690a440bd4b477c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:43Z,use_quota=True,user_id='e85927ec3fc8462f92402af7f456d03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Creating volume 0a477621-f2ac-42fb-8638-ab701bb410ef {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:43:56 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:56 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef 1073741824 Sep 25 10:43:56 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8f6f91-f531-4532-9142-51cd732158a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9', 'volume_size': 1, 'source_volid': '6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b', 'source_volstatus': 'available'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b7e80a-745b-48ac-9383-732885d5af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:56 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Volume volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 (4117736c-31a1-4ba3-bdd3-c8d426fff8f9): created successfully Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b7e80a-745b-48ac-9383-732885d5af4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (afa22bdc-63f4-4e25-a772-fecb05750ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-edc8f90a-6658-4eee-82c1-52e6cdbe12f2 tempest-VolumesGetTest-1991319628 None] Created volume successfully. Sep 25 10:43:56 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef 1073741824" returned: 0 in 0.614s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:57 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef Sep 25 10:43:57 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:57 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef" returned: 0 in 0.320s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.185s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bc25fe-a11d-4c9b-a051-ddedcb6b8187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a477621-f2ac-42fb-8638-ab701bb410ef', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd167b9a-a0ee-4111-ba59-4752dc9b801f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Creating offline snapshot aaeeed84-3448-49b0-8925-507da6df5bb4 of volume 63541436-c73a-4874-abbc-f73769eea02a {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:43:57 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Volume volume-0a477621-f2ac-42fb-8638-ab701bb410ef (0a477621-f2ac-42fb-8638-ab701bb410ef): created successfully Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd167b9a-a0ee-4111-ba59-4752dc9b801f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Flow 'volume_create_manager' (a98e1d10-15a2-4abb-81ca-0746fe5d4b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:57 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-9534595e-30dd-40a1-af27-e547da89a96a tempest-VolumesTransfersV357Test-742900549 None] Created volume successfully. Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e71b3fd-7f71-4909-8f8d-946df740e5e6]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:43:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:57 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a Sep 25 10:43:57 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:58 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a" returned: 0 in 0.532s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:58 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 1G Sep 25 10:43:58 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (79b30c52-d9a1-4c97-8c33-e0870827842a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b504d62e-6d6c-41cd-9fa6-4620bb92f53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b504d62e-6d6c-41cd-9fa6-4620bb92f53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-673142300',display_name='tempest-VolumesGetTest-Volume-1953546411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f00452-fd22-4526-ac4f-243651e491ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:58Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f85348-f61e-4753-82f3-7fb2dcdff662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f85348-f61e-4753-82f3-7fb2dcdff662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362c328d-abd0-4be0-8c1e-be7fc17a663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362c328d-abd0-4be0-8c1e-be7fc17a663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f00452-fd22-4526-ac4f-243651e491ff', 'volume_name': 'volume-b7f00452-fd22-4526-ac4f-243651e491ff', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed2fa8f-309c-4ada-8382-0518351404ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed2fa8f-309c-4ada-8382-0518351404ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d8dfb4-e80e-48f7-a86a-d5492f837a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:43:58 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Volume b7f00452-fd22-4526-ac4f-243651e491ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f00452-fd22-4526-ac4f-243651e491ff', 'volume_size': 1} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:43:58 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 1G" returned: 0 in 0.782s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63541436-c73a-4874-abbc-f73769eea02a -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:58 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63541436-c73a-4874-abbc-f73769eea02a -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 Sep 25 10:43:58 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:59 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63541436-c73a-4874-abbc-f73769eea02a -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4" returned: 0 in 0.543s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:59 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 is being set with open permissions: ugo+rw Sep 25 10:43:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:59 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 Sep 25 10:43:59 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:43:59 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-36bb5f27-3085-4287-934c-049a371ee12d tempest-VolumesTransfersV357Test-377986485 None] Transfer volume completed successfully. Sep 25 10:43:59 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 25 10:43:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4" returned: 0 in 0.411s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:43:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:43:59 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.info Sep 25 10:43:59 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:00 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.info" returned: 0 in 0.395s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:00 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.info is being set with open permissions: ugo+rw Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:00 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.info Sep 25 10:44:00 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Acquiring lock "cinder-0a477621-f2ac-42fb-8638-ab701bb410ef-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Lock "cinder-0a477621-f2ac-42fb-8638-ab701bb410ef-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:00 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Acquiring lock "cinder-quobyte-0a477621-f2ac-42fb-8638-ab701bb410ef" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.info" returned: 0 in 0.435s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.368s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:43:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-673142300',display_name='tempest-VolumesGetTest-Volume-1953546411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f00452-fd22-4526-ac4f-243651e491ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:43:58Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Creating volume b7f00452-fd22-4526-ac4f-243651e491ff {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:00 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:00 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff 1073741824 Sep 25 10:44:00 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Lock "cinder-quobyte-0a477621-f2ac-42fb-8638-ab701bb410ef" acquired by "delete_volume" :: waited 0.087s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf2213f-3142-42bc-a9bb-e32f1973027c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:00 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a43ad4f1-5594-4a8c-95f0-4ddcad0a66ac tempest-VolumesSnapshotTestJSON-812185311 None] Create snapshot completed successfully Sep 25 10:44:01 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef Sep 25 10:44:01 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:01 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff 1073741824" returned: 0 in 0.625s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:01 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef" returned: 0 in 0.585s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:01 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:01 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:01 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff Sep 25 10:44:01 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-aaeeed84-3448-49b0-8925-507da6df5bb4-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-aaeeed84-3448-49b0-8925-507da6df5bb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-63541436-c73a-4874-abbc-f73769eea02a" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-63541436-c73a-4874-abbc-f73769eea02a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-aaeeed84-3448-49b0-8925-507da6df5bb4" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-aaeeed84-3448-49b0-8925-507da6df5bb4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Deleting offline snapshot aaeeed84-3448-49b0-8925-507da6df5bb4 of volume 63541436-c73a-4874-abbc-f73769eea02a {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] snapshot_file for this snap is: volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[834bc5aa-ce7b-4337-9251-a3f22c824e03]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:01 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0a477621-f2ac-42fb-8638-ab701bb410ef" returned: 0 in 0.435s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Lock "cinder-quobyte-0a477621-f2ac-42fb-8638-ab701bb410ef" released by "delete_volume" :: held 1.103s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:01 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 Sep 25 10:44:01 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:01 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Created reservations ['208f5a3b-7294-4096-b448-4c99a8642d71', 'af8c4b1d-1c0e-4b3a-8106-040b86b3ab83', 'b9eb5c98-7b33-4166-9880-eb36eab048bf', '327bc3f9-41fa-412e-8314-ec0ddc32273e'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:02 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff" returned: 0 in 0.576s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d8dfb4-e80e-48f7-a86a-d5492f837a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f00452-fd22-4526-ac4f-243651e491ff', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b7aca8-8bb9-41ca-9def-bd277ed775c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:02 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Volume volume-b7f00452-fd22-4526-ac4f-243651e491ff (b7f00452-fd22-4526-ac4f-243651e491ff): created successfully Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b7aca8-8bb9-41ca-9def-bd277ed775c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (79b30c52-d9a1-4c97-8c33-e0870827842a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:02 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d8e17b23-e831-46fb-a01a-2116f92a8a16 tempest-VolumesGetTest-1991319628 None] Created volume successfully. Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:02 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:02 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:02 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4" returned: 0 in 0.617s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63541436-c73a-4874-abbc-f73769eea02a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb92b1ac-99a4-4448-85dd-bee98a40e124]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:02 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.323s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:02 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Deleted volume successfully. Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f465b657-6ea4-4744-90e3-9f5affa83f27 tempest-VolumesTransfersV357Test-797155810 None] Lock "cinder-0a477621-f2ac-42fb-8638-ab701bb410ef-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:02 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a Sep 25 10:44:02 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:02 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a" returned: 0 in 0.490s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-b7f00452-fd22-4526-ac4f-243651e491ff-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:02 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 Sep 25 10:44:02 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Lock "cinder-b7f00452-fd22-4526-ac4f-243651e491ff-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-quobyte-b7f00452-fd22-4526-ac4f-243651e491ff" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-b7f00452-fd22-4526-ac4f-243651e491ff" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea546e9c-921b-4dcb-a271-0f27efec9bf7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:03 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff Sep 25 10:44:03 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:03 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:03 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:03 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4" returned: 0 in 0.630s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:03 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4 Sep 25 10:44:03 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Flow 'volume_create_manager' (33e76659-ed2e-45ea-8b54-43b4bdecf285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b72ee97-202e-4c58-8f69-10f29934a2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b72ee97-202e-4c58-8f69-10f29934a2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1035408903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d478bf05-8760-4692-883e-e349877fa86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fa8ed7c1fb46a690a440bd4b477c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:04Z,use_quota=True,user_id='e85927ec3fc8462f92402af7f456d03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:03 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9db5c9-2d47-4fa8-b4eb-f19d9bbccfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9db5c9-2d47-4fa8-b4eb-f19d9bbccfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c04b933-aecb-4fad-a335-34ddf1ae3b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c04b933-aecb-4fad-a335-34ddf1ae3b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd478bf05-8760-4692-883e-e349877fa86d', 'volume_name': 'volume-d478bf05-8760-4692-883e-e349877fa86d', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac72e2ff-9406-493c-b3b9-c935e46ed234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac72e2ff-9406-493c-b3b9-c935e46ed234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31926bb0-0acf-4090-a80a-0c5780ef193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:03 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Volume d478bf05-8760-4692-883e-e349877fa86d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d478bf05-8760-4692-883e-e349877fa86d', 'volume_size': 1} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1035408903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d478bf05-8760-4692-883e-e349877fa86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fa8ed7c1fb46a690a440bd4b477c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:04Z,use_quota=True,user_id='e85927ec3fc8462f92402af7f456d03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Creating volume d478bf05-8760-4692-883e-e349877fa86d {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:03 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:44:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff" returned: 0 in 0.860s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:04 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:04 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.515s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:04 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d 1073741824 Sep 25 10:44:04 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:44:04 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a.aaeeed84-3448-49b0-8925-507da6df5bb4" returned: 0 in 0.481s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:04 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-aaeeed84-3448-49b0-8925-507da6df5bb4" released by "_delete_snapshot" :: held 2.437s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-63541436-c73a-4874-abbc-f73769eea02a" released by "delete_snapshot" :: held 2.491s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Created reservations ['92b5b26c-7c94-4cc8-b63f-503761f490af', 'd2d4a087-a032-4ea5-a5ff-a7cb9e74ab25', '18d7c92d-d02d-415a-b522-ed27d5b4441a', '0ffd1dd2-a62a-4a32-844b-1655547fb120'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Delete snapshot completed successfully. Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-953c6791-9e76-45e8-99dd-57cdd1384bac tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-aaeeed84-3448-49b0-8925-507da6df5bb4-delete_snapshot" released by "delete_snapshot" :: held 2.788s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:04 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b7f00452-fd22-4526-ac4f-243651e491ff" returned: 0 in 0.400s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-b7f00452-fd22-4526-ac4f-243651e491ff" released by "delete_volume" :: held 1.318s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Created reservations ['f1558a01-2a1a-4ee9-8ed8-33861263937f', '70aebad1-9da6-43b1-97b4-8a6b1f439590', '03fcf390-16e2-4e7d-a31c-31ec43986e77', '31ba31a3-3013-4568-bbfe-b4cdf6d45789'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:04 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:04 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:04 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d 1073741824" returned: 0 in 0.785s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:04 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d Sep 25 10:44:04 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:05 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.399s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:05 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Deleted volume successfully. Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a35230b6-3e8c-4d78-8713-d58bcf7378fd tempest-VolumesGetTest-1991319628 None] Lock "cinder-b7f00452-fd22-4526-ac4f-243651e491ff-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:05 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d" returned: 0 in 0.366s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31926bb0-0acf-4090-a80a-0c5780ef193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d478bf05-8760-4692-883e-e349877fa86d', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ac4999-a753-48ca-8254-bb4046f17101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:05 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Volume volume-d478bf05-8760-4692-883e-e349877fa86d (d478bf05-8760-4692-883e-e349877fa86d): created successfully Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ac4999-a753-48ca-8254-bb4046f17101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Flow 'volume_create_manager' (33e76659-ed2e-45ea-8b54-43b4bdecf285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:05 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2840a3ce-36bb-4492-a86f-226974137a38 tempest-VolumesTransfersV357Test-742900549 None] Created volume successfully. Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-4117736c-31a1-4ba3-bdd3-c8d426fff8f9-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Lock "cinder-4117736c-31a1-4ba3-bdd3-c8d426fff8f9-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-quobyte-4117736c-31a1-4ba3-bdd3-c8d426fff8f9" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-4117736c-31a1-4ba3-bdd3-c8d426fff8f9" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[293cd34e-1020-4ec4-b00d-cf9b7e1dcb04]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Flow 'volume_create_manager' (5fb30902-1ff1-477a-8c3d-d07d63f4f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb5164d-3cbf-46ae-beba-c1106ff9b446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb5164d-3cbf-46ae-beba-c1106ff9b446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-490668111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a1e182-a679-4abb-a590-ffc48ca0315b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888fb91633114569ac179276ed29670a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:06Z,use_quota=True,user_id='4f1f8c51f8a444a1a016088efeea5f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be47510-dd98-49bd-84aa-b538e4c58dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be47510-dd98-49bd-84aa-b538e4c58dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb06c38-85f3-4403-bdd2-550b52d1fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb06c38-85f3-4403-bdd2-550b52d1fe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50a1e182-a679-4abb-a590-ffc48ca0315b', 'volume_name': 'volume-50a1e182-a679-4abb-a590-ffc48ca0315b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba9c98f-d981-4270-8f92-dc9330510bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba9c98f-d981-4270-8f92-dc9330510bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a6fdce-495e-485d-8b92-f56e2364d1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:05 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Volume 50a1e182-a679-4abb-a590-ffc48ca0315b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50a1e182-a679-4abb-a590-ffc48ca0315b', 'volume_size': 1} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-490668111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a1e182-a679-4abb-a590-ffc48ca0315b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888fb91633114569ac179276ed29670a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:06Z,use_quota=True,user_id='4f1f8c51f8a444a1a016088efeea5f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Creating volume 50a1e182-a679-4abb-a590-ffc48ca0315b {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:05 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 Sep 25 10:44:05 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:05 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:44:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:05 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b 1073741824 Sep 25 10:44:05 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:06 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9" returned: 0 in 0.585s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:06 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9 Sep 25 10:44:06 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Acquiring lock "cinder-d478bf05-8760-4692-883e-e349877fa86d-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Lock "cinder-d478bf05-8760-4692-883e-e349877fa86d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Acquiring lock "cinder-quobyte-d478bf05-8760-4692-883e-e349877fa86d" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Lock "cinder-quobyte-d478bf05-8760-4692-883e-e349877fa86d" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb99855-844d-41ff-9a02-a882d5e19a2d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:06 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b 1073741824" returned: 0 in 0.659s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:06 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:06 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b Sep 25 10:44:06 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4117736c-31a1-4ba3-bdd3-c8d426fff8f9" returned: 0 in 0.405s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:06 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d Sep 25 10:44:06 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-4117736c-31a1-4ba3-bdd3-c8d426fff8f9" released by "delete_volume" :: held 1.067s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Created reservations ['d6dd0426-0dde-4383-a17e-eb1816500550', '2116d654-a1db-4a29-b213-a0a5a42b949c', '74d094dd-bad9-4308-aab6-6723607d7cd1', '2ca97aad-a501-4421-9c78-1ee6c294d4f6'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:06 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:06 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:06 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b" returned: 0 in 0.354s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a6fdce-495e-485d-8b92-f56e2364d1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50a1e182-a679-4abb-a590-ffc48ca0315b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265a0472-7302-4ce6-9b2f-e6cf60856aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:07 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Volume volume-50a1e182-a679-4abb-a590-ffc48ca0315b (50a1e182-a679-4abb-a590-ffc48ca0315b): created successfully Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265a0472-7302-4ce6-9b2f-e6cf60856aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Flow 'volume_create_manager' (5fb30902-1ff1-477a-8c3d-d07d63f4f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8a9e8453-51de-4e8e-b5ca-8293417671ee tempest-VolumesSnapshotTestJSON-812185311 None] Created volume successfully. Sep 25 10:44:07 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d" returned: 0 in 0.519s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:07 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d Sep 25 10:44:07 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:07 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.315s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Deleted volume successfully. Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-46c55228-44f6-4ceb-975a-e57ea946a291 tempest-VolumesGetTest-1991319628 None] Lock "cinder-4117736c-31a1-4ba3-bdd3-c8d426fff8f9-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:07 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d478bf05-8760-4692-883e-e349877fa86d" returned: 0 in 0.319s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Lock "cinder-quobyte-d478bf05-8760-4692-883e-e349877fa86d" released by "delete_volume" :: held 0.901s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Created reservations ['b40b35cd-3d82-4108-afcd-fb65a0de5a3f', '38072a46-0bd1-459c-8b2b-5dcc62f281f0', '22a53528-8382-497e-95f8-e7985724d598', 'eb3c6323-696d-4243-a7b6-80b4b5d24f2c'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:07 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:07 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Lock "cinder-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:07 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.401s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:07 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Deleted volume successfully. Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-quobyte-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1b4c31bb-e26b-4eb0-8429-3a8af2c2b3a0 tempest-VolumesTransfersV357Test-797155810 None] Lock "cinder-d478bf05-8760-4692-883e-e349877fa86d-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b" acquired by "delete_volume" :: waited 0.039s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7b2c10-689f-47f9-9884-76a0e299dfc1]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:08 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b Sep 25 10:44:08 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Creating offline snapshot fa51b67f-7b15-4646-a30a-0bf8ee2904bf of volume 50a1e182-a679-4abb-a590-ffc48ca0315b {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[37894336-c135-435c-af69-b427a531e1ab]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:08 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b Sep 25 10:44:08 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:08 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b" returned: 0 in 0.684s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:08 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b Sep 25 10:44:08 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:08 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b" returned: 0 in 0.486s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:09 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf 1G Sep 25 10:44:09 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:09 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b" returned: 0 in 0.358s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b" released by "delete_volume" :: held 1.159s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Created reservations ['e7313a01-ed31-4aad-ada7-eb794cef794e', '3d32bd9f-52ac-42b8-a3cc-6daf888c391e', '151085f7-e82a-4767-b1fc-58fc734186fc', '1eb1690e-c17a-4d63-ae28-9bbcbe588b0d'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:09 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:09 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:09 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf 1G" returned: 0 in 0.633s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50a1e182-a679-4abb-a590-ffc48ca0315b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:09 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50a1e182-a679-4abb-a590-ffc48ca0315b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf Sep 25 10:44:09 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:09 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.384s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Deleted volume successfully. Sep 25 10:44:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60ae8cef-cee0-4dcb-afd2-5910b532d69b tempest-VolumesGetTest-1991319628 None] Lock "cinder-6afc88ff-2d8c-4ec1-9a2c-7807ccf7771b-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:10 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50a1e182-a679-4abb-a590-ffc48ca0315b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf" returned: 0 in 0.446s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:10 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf is being set with open permissions: ugo+rw Sep 25 10:44:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:10 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf Sep 25 10:44:10 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:10 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf" returned: 0 in 0.458s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:10 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.info Sep 25 10:44:10 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:10 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.info" returned: 0 in 0.394s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:11 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.info is being set with open permissions: ugo+rw Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:11 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.info Sep 25 10:44:11 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:11 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.info" returned: 0 in 0.451s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.053s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (cd3a61a4-39e1-4df3-8ff1-13ef574ca909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482c404f-956c-4b05-afcb-50573cdc0ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8db4571a-bf0e-4bee-a241-23e81ab69163 tempest-VolumesSnapshotTestJSON-812185311 None] Create snapshot completed successfully Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482c404f-956c-4b05-afcb-50573cdc0ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-430825888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afc0850-543d-452e-ae3f-cac17ffcc5c3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:11Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658aa218-8edf-45bb-ab85-85e130103693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658aa218-8edf-45bb-ab85-85e130103693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899d66e7-e3e3-4f85-b139-ec19398f0fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:11 devstack cinder-volume[87242]: DEBUG cinder.image.glance [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Creating Keystone auth plugin from conf {{(pid=87242) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:44:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899d66e7-e3e3-4f85-b139-ec19398f0fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4afc0850-543d-452e-ae3f-cac17ffcc5c3', 'volume_name': 'volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e837fb0-9fde-4b6b-8731-91ee2628ff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e837fb0-9fde-4b6b-8731-91ee2628ff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5aedbd-99cc-4215-8c20-91fcc3a11e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:12 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Volume 4afc0850-543d-452e-ae3f-cac17ffcc5c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 10:44:12 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Trying to clone 4afc0850-543d-452e-ae3f-cac17ffcc5c3 from image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]). {{(pid=87242) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:44:13 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Image download 20.69 MB at 20.69 MB/s Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c00e36-22d1-4e4c-a4e6-d386b00511f2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:13 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD Sep 25 10:44:13 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:13 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Temporary image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c is fetched for user 23757498c09044b1a647322650890a0f. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[18854cec-0328-4767-8583-2e45a6bb3be0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Flow 'volume_create_manager' (fd487da0-ab9c-4652-9ae7-8b811f78f65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38ab98d-29af-4d7d-9f25-498f8afcd1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38ab98d-29af-4d7d-9f25-498f8afcd1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2018019390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888fb91633114569ac179276ed29670a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fa51b67f-7b15-4646-a30a-0bf8ee2904bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:14Z,use_quota=True,user_id='4f1f8c51f8a444a1a016088efeea5f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391a1dc9-6501-4e61-9b3c-11f3566f47a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391a1dc9-6501-4e61-9b3c-11f3566f47a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53eaac0a-9d8a-49a6-910a-c0bda466efa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53eaac0a-9d8a-49a6-910a-c0bda466efa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c', 'volume_name': 'volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c', 'volume_size': 2, 'snapshot_id': 'fa51b67f-7b15-4646-a30a-0bf8ee2904bf'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece75ccb-fe93-408c-a60f-3a1383f51214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece75ccb-fe93-408c-a60f-3a1383f51214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dadcb9-8e4e-4f43-8bc0-da622dd8a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:13 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Volume 0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c', 'volume_size': 2, 'snapshot_id': 'fa51b67f-7b15-4646-a30a-0bf8ee2904bf'} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-fa51b67f-7b15-4646-a30a-0bf8ee2904bf-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" by "_create_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:13 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD Sep 25 10:44:13 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-fa51b67f-7b15-4646-a30a-0bf8ee2904bf-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Creating volume 0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c from snapshot fa51b67f-7b15-4646-a30a-0bf8ee2904bf {{(pid=87242) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] snapshot: fa51b67f-7b15-4646-a30a-0bf8ee2904bf, volume: 0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e88a2ac-6297-478e-afa4-4b5cc2512b77]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:14 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:14 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf Sep 25 10:44:14 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:14 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf" returned: 0 in 0.556s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50a1e182-a679-4abb-a590-ffc48ca0315b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[961aac4f-eee5-4de9-b591-ce61653bcb37]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:14 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b Sep 25 10:44:14 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:15 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b" returned: 0 in 0.504s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:44:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:44:15 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:44:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:15 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c Sep 25 10:44:15 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:23 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=62,cinder:SELECT=53,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:44:23 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=67,cinder:SELECT=58,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:44:24 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" returned: 0 in 8.937s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:44:24 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Converted 1024.00 MB image at 114.57 MB/s Sep 25 10:44:24 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c is being set with open permissions: ugo+rw Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:24 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c Sep 25 10:44:24 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:24 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" returned: 0 in 0.291s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" released by "_copy_volume_from_snapshot" :: held 10.428s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-fa51b67f-7b15-4646-a30a-0bf8ee2904bf-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" released by "_create_volume_from_snapshot" :: held 10.525s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.542s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.215s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-430825888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afc0850-543d-452e-ae3f-cac17ffcc5c3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:11Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Creating volume 4afc0850-543d-452e-ae3f-cac17ffcc5c3 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:24 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:24 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 1073741824 Sep 25 10:44:24 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dadcb9-8e4e-4f43-8bc0-da622dd8a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c', 'volume_size': 2, 'snapshot_id': 'fa51b67f-7b15-4646-a30a-0bf8ee2904bf'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7409bf94-fb7d-4cef-9e55-95efd1d41869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:24 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Volume volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c (0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c): created successfully Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7409bf94-fb7d-4cef-9e55-95efd1d41869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Flow 'volume_create_manager' (fd487da0-ab9c-4652-9ae7-8b811f78f65a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:24 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b318f53d-8240-4e6d-96ab-0785d0c9bdf5 tempest-VolumesSnapshotTestJSON-812185311 None] Created volume successfully. Sep 25 10:44:25 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 1073741824" returned: 0 in 0.677s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:25 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 Sep 25 10:44:25 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" acquired by "delete_volume" :: waited 0.041s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69af0ad-877c-4c2a-bc79-bba52f01a94e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:25 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3" returned: 0 in 0.403s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Attempting download of 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c ((None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}])) to volume 4afc0850-543d-452e-ae3f-cac17ffcc5c3. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 10:44:25 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c Sep 25 10:44:25 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c85c349-d0f6-4f23-8ec9-201969b561f6]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_076a7g38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:25 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_076a7g38 Sep 25 10:44:25 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:26 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" returned: 0 in 0.664s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:26 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c Sep 25 10:44:26 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:26 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_076a7g38" returned: 0 in 0.575s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_076a7g38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:26 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_076a7g38 Sep 25 10:44:26 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:26 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" returned: 0 in 0.504s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c" released by "delete_volume" :: held 1.240s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Created reservations ['505117bb-3e13-4d75-a031-58e4bbdf3e17', '119f0c8e-76cd-4922-95c8-edcb46990ad9', '64d3fbdf-c2d2-42b1-8fa7-6e4f12575666', '0e618371-ee3c-42f4-8f8e-b30c0a913b56'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:26 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_076a7g38" returned: 1 in 0.623s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_076a7g38' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9805a301-7365-43c8-8560-114a9690785a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:26 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:26 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:27 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD Sep 25 10:44:27 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:27 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.419s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:27 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Deleted volume successfully. Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-036dd908-00ad-477e-bd15-0064850efd2c tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-0ebc2bbe-489c-4930-b6f6-faabe6cbbc5c-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:27 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c was qcow2, converting to qcow2 {{(pid=87242) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:27 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 Sep 25 10:44:27 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-fa51b67f-7b15-4646-a30a-0bf8ee2904bf-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-fa51b67f-7b15-4646-a30a-0bf8ee2904bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-50a1e182-a679-4abb-a590-ffc48ca0315b" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-50a1e182-a679-4abb-a590-ffc48ca0315b" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-fa51b67f-7b15-4646-a30a-0bf8ee2904bf" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-fa51b67f-7b15-4646-a30a-0bf8ee2904bf" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Deleting offline snapshot fa51b67f-7b15-4646-a30a-0bf8ee2904bf of volume 50a1e182-a679-4abb-a590-ffc48ca0315b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] snapshot_file for this snap is: volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe016bb-81df-4a54-af56-f57094d322f1]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:28 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf Sep 25 10:44:28 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:28 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf" returned: 0 in 0.628s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50a1e182-a679-4abb-a590-ffc48ca0315b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:44:28 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a3d9b7-2632-4ce1-9e3f-2ef45d09b063]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:28 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b Sep 25 10:44:28 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:29 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b" returned: 0 in 1.045s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:29 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf Sep 25 10:44:29 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:30 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf" returned: 0 in 0.512s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:30 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf Sep 25 10:44:30 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:30 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3" returned: 0 in 3.025s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_hjq_d2igdevstack@QuobyteHD, size 112.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:44:30 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Converted 112.00 MB image at 37.01 MB/s Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:30 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 1G Sep 25 10:44:30 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:30 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b.fa51b67f-7b15-4646-a30a-0bf8ee2904bf" returned: 0 in 0.366s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-fa51b67f-7b15-4646-a30a-0bf8ee2904bf" released by "_delete_snapshot" :: held 2.721s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-50a1e182-a679-4abb-a590-ffc48ca0315b" released by "delete_snapshot" :: held 2.761s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Created reservations ['d9b7edbe-b969-4ef8-9ef4-c960e1d12296', '0ea4e678-d99d-4dd9-b79a-0bd0f929163f', 'c9d92944-70db-4d08-a4b7-2be8e6e190d5', '55393cc0-49a5-4cde-850c-cd87065830db'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Delete snapshot completed successfully. Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dc54df8f-8a85-4a9a-8b48-f4c3bea10765 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-fa51b67f-7b15-4646-a30a-0bf8ee2904bf-delete_snapshot" released by "delete_snapshot" :: held 3.048s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:30 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 1G" returned: 0 in 0.467s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Downloaded image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c ((None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}])) to volume 4afc0850-543d-452e-ae3f-cac17ffcc5c3 successfully. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Temporary image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c for user 23757498c09044b1a647322650890a0f is deleted. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Marking volume 4afc0850-543d-452e-ae3f-cac17ffcc5c3 as bootable. {{(pid=87242) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Copying metadata from image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c to 4afc0850-543d-452e-ae3f-cac17ffcc5c3. {{(pid=87242) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:44:30 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Creating volume glance metadata for volume 4afc0850-543d-452e-ae3f-cac17ffcc5c3 backed by image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87242) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5aedbd-99cc-4215-8c20-91fcc3a11e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5137b0-79fa-470d-8f50-bae4ecbcf8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:31 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Volume volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 (4afc0850-543d-452e-ae3f-cac17ffcc5c3): created successfully Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5137b0-79fa-470d-8f50-bae4ecbcf8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (cd3a61a4-39e1-4df3-8ff1-13ef574ca909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:31 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-056f2ef3-f3ab-4778-ba40-4439063f9fc8 tempest-VolumesGetTest-1991319628 None] Created volume successfully. Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-50a1e182-a679-4abb-a590-ffc48ca0315b-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-50a1e182-a679-4abb-a590-ffc48ca0315b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-50a1e182-a679-4abb-a590-ffc48ca0315b" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-50a1e182-a679-4abb-a590-ffc48ca0315b" acquired by "delete_volume" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2353e2cb-0773-4c8a-84f4-0a95f5f56e08]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:31 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b Sep 25 10:44:31 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:31 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b" returned: 0 in 0.469s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:32 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b Sep 25 10:44:32 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:32 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50a1e182-a679-4abb-a590-ffc48ca0315b" returned: 0 in 0.430s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-50a1e182-a679-4abb-a590-ffc48ca0315b" released by "delete_volume" :: held 0.991s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:32 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Created reservations ['c8ce9e15-deca-4a6a-94e3-c47fd241050f', '5d7ed539-c273-4d50-9c04-7a90bd87b724', '5a4b14c2-3237-44ba-99b7-a32ad31ba447', '00d3dba0-2d1b-43bb-a3bb-27a2fbe96fed'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:32 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:32 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:33 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (6e432cb4-3724-4dfa-8578-de36b57bbe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c860d3f-77c8-4055-a1b5-4ddd72fca672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.392s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:33 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Deleted volume successfully. Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c860d3f-77c8-4055-a1b5-4ddd72fca672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-364806647',display_name='tempest-VolumesGetTest-Volume-1641248610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141004e6-8110-474d-8329-fcbe1fe70e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:33Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f4a340-9be8-4c54-88fb-3a82ba7f9748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f4a340-9be8-4c54-88fb-3a82ba7f9748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349916f6-73f6-41ed-98d0-19fe996bdde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349916f6-73f6-41ed-98d0-19fe996bdde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141004e6-8110-474d-8329-fcbe1fe70e71', 'volume_name': 'volume-141004e6-8110-474d-8329-fcbe1fe70e71', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923a7367-500f-4165-a1f4-c82ff51e514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923a7367-500f-4165-a1f4-c82ff51e514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e526cb-91c1-4032-bf86-402d901d8f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:33 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Volume 141004e6-8110-474d-8329-fcbe1fe70e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141004e6-8110-474d-8329-fcbe1fe70e71', 'volume_size': 1} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-364806647',display_name='tempest-VolumesGetTest-Volume-1641248610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141004e6-8110-474d-8329-fcbe1fe70e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd5bc534324b3fa3870f959c89c363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:33Z,use_quota=True,user_id='23757498c09044b1a647322650890a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Creating volume 141004e6-8110-474d-8329-fcbe1fe70e71 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:33 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:33 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71 1073741824 Sep 25 10:44:33 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2dc4a02c-176e-48df-a616-7f3bf57b62ba tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-50a1e182-a679-4abb-a590-ffc48ca0315b-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:33 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71 1073741824" returned: 0 in 0.644s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:33 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71 Sep 25 10:44:33 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:34 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e526cb-91c1-4032-bf86-402d901d8f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141004e6-8110-474d-8329-fcbe1fe70e71', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e767cb9e-4e87-4289-ab29-ec533d19c457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:34 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Volume volume-141004e6-8110-474d-8329-fcbe1fe70e71 (141004e6-8110-474d-8329-fcbe1fe70e71): created successfully Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e767cb9e-4e87-4289-ab29-ec533d19c457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Flow 'volume_create_manager' (6e432cb4-3724-4dfa-8578-de36b57bbe67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:34 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5f670e73-873a-4274-b4cf-3d0798ea3e83 tempest-VolumesGetTest-1991319628 None] Created volume successfully. Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Flow 'volume_create_manager' (86c65d3b-87c4-4290-b90d-0028b20f9292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a825f2de-e4e2-4db9-8618-83200f8ca297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a825f2de-e4e2-4db9-8618-83200f8ca297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-279273892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888fb91633114569ac179276ed29670a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:34Z,use_quota=True,user_id='4f1f8c51f8a444a1a016088efeea5f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc50f85c-1a29-4db4-aa11-cc5c3b510c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc50f85c-1a29-4db4-aa11-cc5c3b510c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147e5197-0538-42c3-8958-42b9ebf8ff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147e5197-0538-42c3-8958-42b9ebf8ff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3', 'volume_name': 'volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb213b94-88e8-4185-bacc-73bf1001a24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb213b94-88e8-4185-bacc-73bf1001a24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eba30d7-ff44-430c-bd4e-d907f6c6d68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:34 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Volume a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3', 'volume_size': 1} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-279273892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888fb91633114569ac179276ed29670a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:34Z,use_quota=True,user_id='4f1f8c51f8a444a1a016088efeea5f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Creating volume a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:34 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:44:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:34 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 1073741824 Sep 25 10:44:34 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:35 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 1073741824" returned: 0 in 0.627s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-141004e6-8110-474d-8329-fcbe1fe70e71-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:35 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 Sep 25 10:44:35 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Lock "cinder-141004e6-8110-474d-8329-fcbe1fe70e71-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-quobyte-141004e6-8110-474d-8329-fcbe1fe70e71" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-141004e6-8110-474d-8329-fcbe1fe70e71" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0fe3a5-8f76-44b0-b716-a79fbe4f0c3b]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:35 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71 Sep 25 10:44:35 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:35 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" returned: 0 in 0.461s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eba30d7-ff44-430c-bd4e-d907f6c6d68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e294d9-a03b-467c-bbef-ca49b81a805f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:35 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Volume volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 (a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3): created successfully Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e294d9-a03b-467c-bbef-ca49b81a805f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Flow 'volume_create_manager' (86c65d3b-87c4-4290-b90d-0028b20f9292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ea5ea8b1-de55-4b40-bb18-e9a97ffb1ac7 tempest-VolumesSnapshotTestJSON-812185311 None] Created volume successfully. Sep 25 10:44:36 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71" returned: 0 in 0.515s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:36 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71 Sep 25 10:44:36 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:36 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-141004e6-8110-474d-8329-fcbe1fe70e71" returned: 0 in 0.462s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-141004e6-8110-474d-8329-fcbe1fe70e71" released by "delete_volume" :: held 1.108s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Created reservations ['ddefae88-41ff-4c2f-8fd5-c1a54112ad0b', '9394c528-2214-478c-9186-5254d458bb8b', '01ae57b0-2ef5-4f7d-83c5-7fafb6aee747', '5bd080b8-e7f9-4ae1-89a7-88530983e6e2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:36 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:36 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Creating offline snapshot c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 of volume a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:44:37 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca65fa1-5c4c-49e7-b1c0-259466b5c1bf]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:37 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.357s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:37 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:37 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Deleted volume successfully. Sep 25 10:44:37 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 Sep 25 10:44:37 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-93beb479-64b4-4478-9d3f-f51afa1d9b53 tempest-VolumesGetTest-1991319628 None] Lock "cinder-141004e6-8110-474d-8329-fcbe1fe70e71-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:37 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" returned: 0 in 0.637s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:37 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 1G Sep 25 10:44:37 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:38 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 1G" returned: 0 in 0.907s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:38 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 Sep 25 10:44:38 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-4afc0850-543d-452e-ae3f-cac17ffcc5c3-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Lock "cinder-4afc0850-543d-452e-ae3f-cac17ffcc5c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Acquiring lock "cinder-quobyte-4afc0850-543d-452e-ae3f-cac17ffcc5c3" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:38 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Flow 'volume_create_manager' (7eb2cd0f-ae62-41f8-9d3a-74e568b2ffe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f76ceea-cee5-456f-bc2c-c0b01fd6cf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-4afc0850-543d-452e-ae3f-cac17ffcc5c3" acquired by "delete_volume" :: waited 0.103s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d0c204-d60d-49fd-a867-5b12c46ae98d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f76ceea-cee5-456f-bc2c-c0b01fd6cf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-962338084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e76ceeec-913e-4010-bd45-a09ed2b8e3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0161b3b615cc4698af0eca50cb1a44f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:39Z,use_quota=True,user_id='e6ea7071df034118af6f5f25bd6196bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5c7a9e-9c81-4cc3-af28-fbfa41131bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5c7a9e-9c81-4cc3-af28-fbfa41131bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0f99ee-6fb9-4ede-8865-d93b381510c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0f99ee-6fb9-4ede-8865-d93b381510c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e76ceeec-913e-4010-bd45-a09ed2b8e3a2', 'volume_name': 'volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1b92c9-463b-436d-b80e-479de6867b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1b92c9-463b-436d-b80e-479de6867b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:39 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbacd8d9-b3ac-422f-9b9d-6cfd781d6d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:39 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Volume e76ceeec-913e-4010-bd45-a09ed2b8e3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2', 'volume_size': 1} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5" returned: 0 in 0.499s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:39 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 is being set with open permissions: ugo+rw Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:39 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 Sep 25 10:44:39 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Flow 'volume_create_manager' (bf7fc6a4-3ff8-492e-9485-664aec49256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f756dcdf-3b21-4abc-b2bd-3d6f3f6e1872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:39 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 Sep 25 10:44:39 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f756dcdf-3b21-4abc-b2bd-3d6f3f6e1872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1257626068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1466e947-d683-4cab-aad5-1c007fe69622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89af91e0ac7442ff9d5093cb359b5597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:39Z,use_quota=True,user_id='6163d9566dba48ada5c21cdd32e75b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c239d313-2d76-497e-9099-f2a86d603b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c239d313-2d76-497e-9099-f2a86d603b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2bb20a-760b-4674-bdd4-848679ee4aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2bb20a-760b-4674-bdd4-848679ee4aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1466e947-d683-4cab-aad5-1c007fe69622', 'volume_name': 'volume-1466e947-d683-4cab-aad5-1c007fe69622', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332683e5-fabe-4129-b500-6d3e4d722b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332683e5-fabe-4129-b500-6d3e4d722b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb9c936-d238-4a91-88c6-eb44077b8c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:39 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Volume 1466e947-d683-4cab-aad5-1c007fe69622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1466e947-d683-4cab-aad5-1c007fe69622', 'volume_size': 1} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:39 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5" returned: 0 in 0.294s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:39 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.info Sep 25 10:44:39 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:39 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3" returned: 0 in 0.517s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:39 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3 Sep 25 10:44:39 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:39 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.info" returned: 0 in 0.377s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:39 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.info is being set with open permissions: ugo+rw Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:39 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.info Sep 25 10:44:39 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:39 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4afc0850-543d-452e-ae3f-cac17ffcc5c3" returned: 0 in 0.352s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Lock "cinder-quobyte-4afc0850-543d-452e-ae3f-cac17ffcc5c3" released by "delete_volume" :: held 0.969s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Created reservations ['8b6ba28f-db11-4f6d-894c-c839140fd307', '800461f6-a061-4e35-817c-eced37323a72', 'f42010bc-4df0-45ad-901e-381e71493962', 'd0b0f23f-3608-444f-a93b-d9674447eaee'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:40 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:40 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:40 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.info" returned: 0 in 0.322s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.161s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-962338084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e76ceeec-913e-4010-bd45-a09ed2b8e3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0161b3b615cc4698af0eca50cb1a44f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:39Z,use_quota=True,user_id='e6ea7071df034118af6f5f25bd6196bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Creating volume e76ceeec-913e-4010-bd45-a09ed2b8e3a2 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:40 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:40 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 1073741824 Sep 25 10:44:40 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:40 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-109e3e0c-a3b7-415a-806d-4617f2b2feef tempest-VolumesSnapshotTestJSON-812185311 None] Create snapshot completed successfully Sep 25 10:44:40 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.308s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:40 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Deleted volume successfully. Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4ea97561-b359-4516-b3ab-66f9224eb724 tempest-VolumesGetTest-1991319628 None] Lock "cinder-4afc0850-543d-452e-ae3f-cac17ffcc5c3-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:40 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 1073741824" returned: 0 in 0.519s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:40 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 Sep 25 10:44:40 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:41 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" returned: 0 in 0.390s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.934s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1257626068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1466e947-d683-4cab-aad5-1c007fe69622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89af91e0ac7442ff9d5093cb359b5597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:39Z,use_quota=True,user_id='6163d9566dba48ada5c21cdd32e75b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Creating volume 1466e947-d683-4cab-aad5-1c007fe69622 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:41 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:41 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 1073741824 Sep 25 10:44:41 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbacd8d9-b3ac-422f-9b9d-6cfd781d6d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aafa52d-eff2-4e4c-b508-bdd1220763f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:41 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Volume volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 (e76ceeec-913e-4010-bd45-a09ed2b8e3a2): created successfully Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aafa52d-eff2-4e4c-b508-bdd1220763f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Flow 'volume_create_manager' (7eb2cd0f-ae62-41f8-9d3a-74e568b2ffe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5e67e09a-1dbf-4184-a950-62106260d019 tempest-VolumesActionsTest-445676815 None] Created volume successfully. Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Flow 'volume_create_manager' (59ece33c-c08c-4d6e-903f-04b51f37b337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29fde8f-4c17-4080-b53f-9d17bf0c399c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29fde8f-4c17-4080-b53f-9d17bf0c399c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1526925348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35415e6-5bfd-4e4e-80fc-ae450ba8b30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888fb91633114569ac179276ed29670a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:41Z,use_quota=True,user_id='4f1f8c51f8a444a1a016088efeea5f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85146ce5-25c4-419c-847e-76504ae5df3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85146ce5-25c4-419c-847e-76504ae5df3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d6f655-7a6a-4616-b0d1-6a2890260bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d6f655-7a6a-4616-b0d1-6a2890260bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e35415e6-5bfd-4e4e-80fc-ae450ba8b30e', 'volume_name': 'volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e', 'volume_size': 1, 'snapshot_id': 'c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63aa242-4509-4f6a-8673-31787b9e54b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63aa242-4509-4f6a-8673-31787b9e54b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7ce80d-ec6a-484e-95c7-0e46617acfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:41 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Volume e35415e6-5bfd-4e4e-80fc-ae450ba8b30e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e', 'volume_size': 1, 'snapshot_id': 'c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5'} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:41 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 1073741824" returned: 0 in 0.532s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:41 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 Sep 25 10:44:41 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:42 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622" returned: 0 in 0.309s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.579s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" by "_create_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb9c936-d238-4a91-88c6-eb44077b8c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1466e947-d683-4cab-aad5-1c007fe69622', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e519f6-dfeb-4ff3-bc93-122f5c59b568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Creating volume e35415e6-5bfd-4e4e-80fc-ae450ba8b30e from snapshot c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 {{(pid=87242) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:42 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Volume volume-1466e947-d683-4cab-aad5-1c007fe69622 (1466e947-d683-4cab-aad5-1c007fe69622): created successfully Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e519f6-dfeb-4ff3-bc93-122f5c59b568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Flow 'volume_create_manager' (bf7fc6a4-3ff8-492e-9485-664aec49256d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] snapshot: c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5, volume: e35415e6-5bfd-4e4e-80fc-ae450ba8b30e, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:44:42 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e2aec8a9-fedc-4326-992c-c3c4e3dd7063 tempest-TestImageHashVerification-87157306 None] Created volume successfully. Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0c5ce8-2f2b-4c34-af95-8e09240ccc89]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:42 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 Sep 25 10:44:42 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:42 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5" returned: 0 in 0.507s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a1c075-2e59-40bb-807a-d16281eb45af]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:42 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 Sep 25 10:44:42 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:43 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" returned: 0 in 0.567s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:44:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:44:43 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:44:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:43 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e Sep 25 10:44:43 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:52 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=57,cinder:SELECT=41,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:44:53 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" returned: 0 in 9.622s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3, size 1024.00 MB, duration 9.62 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:44:53 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Converted 1024.00 MB image at 106.41 MB/s Sep 25 10:44:53 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e is being set with open permissions: ugo+rw Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:53 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e Sep 25 10:44:53 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:53 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" returned: 0 in 0.488s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" released by "_copy_volume_from_snapshot" :: held 11.349s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" released by "_create_volume_from_snapshot" :: held 11.512s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.554s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.858s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d1533c-ff7e-4d4e-8377-4560d3cbe331]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7ce80d-ec6a-484e-95c7-0e46617acfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e', 'volume_size': 1, 'snapshot_id': 'c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1913088e-2e72-412d-9e1c-cf7793ab286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:53 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Volume volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e (e35415e6-5bfd-4e4e-80fc-ae450ba8b30e): created successfully Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1913088e-2e72-412d-9e1c-cf7793ab286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Flow 'volume_create_manager' (59ece33c-c08c-4d6e-903f-04b51f37b337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e2e836b1-3fa6-456a-a91b-0728ceb9615f tempest-VolumesSnapshotTestJSON-812185311 None] Created volume successfully. Sep 25 10:44:54 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 Sep 25 10:44:54 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" acquired by "delete_volume" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:54 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622" returned: 0 in 0.879s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db81bef-990c-4fee-ba74-89d996813dbd]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e05c2b3-3d37-4e5f-9b5d-7436a3ed03b2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:54 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 Sep 25 10:44:54 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:54 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e Sep 25 10:44:54 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:55 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" returned: 0 in 0.526s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:55 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e Sep 25 10:44:55 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:55 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622" returned: 0 in 0.554s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 /opt/stack/data/cinder/conversion/1466e947-d683-4cab-aad5-1c007fe69622.temp_image.3b43876a-93f8-4855-b45b-55112a3bf2bfpoxgq19q.img {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:55 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 /opt/stack/data/cinder/conversion/1466e947-d683-4cab-aad5-1c007fe69622.temp_image.3b43876a-93f8-4855-b45b-55112a3bf2bfpoxgq19q.img Sep 25 10:44:55 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:55 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" returned: 0 in 0.378s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e" released by "delete_volume" :: held 0.995s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Created reservations ['4698a8a9-8a9e-4e79-ab92-44cb8d5e2404', '21446b9c-68be-4d12-a041-63e83c639152', '6f8408b4-6090-40c3-99d6-17c26da3af13', '9a86b6ce-4fd4-48ec-9092-8a4bb8342f27'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:44:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:55 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:44:55 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:56 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.855s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:56 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:44:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Deleted volume successfully. Sep 25 10:44:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e7c93272-f564-4026-b5d4-4e2e81cec84d tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-e35415e6-5bfd-4e4e-80fc-ae450ba8b30e-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.119s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Deleting offline snapshot c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 of volume a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] snapshot_file for this snap is: volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabe225b-4ee7-41c8-9faa-fd421a62b3f5]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Flow 'volume_create_manager' (b38318b7-8497-445a-b736-3288232e37ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402d158d-2bce-4c2a-9765-0f1e571d71bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402d158d-2bce-4c2a-9765-0f1e571d71bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-924000456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2beb449-1a80-4bad-94b2-2ce61b56d1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d665820e5948758c80f6bd0df07efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:58Z,use_quota=True,user_id='208c06dc75c74f45bcfaad364bf77015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d72dce2-582b-4a0a-8a69-e5e456e158c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d72dce2-582b-4a0a-8a69-e5e456e158c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3322743f-2b4f-408a-92f3-017259ee265b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3322743f-2b4f-408a-92f3-017259ee265b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2beb449-1a80-4bad-94b2-2ce61b56d1e1', 'volume_name': 'volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a214c2-b37c-4b85-b6aa-53650cedc448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a214c2-b37c-4b85-b6aa-53650cedc448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:44:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db341359-d10d-4f9f-95d7-400280d2338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:44:58 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Volume a2beb449-1a80-4bad-94b2-2ce61b56d1e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1', 'volume_size': 1} Sep 25 10:44:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:44:58 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 Sep 25 10:44:58 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:44:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfb31d7e-2933-466f-9877-19352e462481 tempest-VolumesActionsTest-445676815 None] Acquiring lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" by "attach_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfb31d7e-2933-466f-9877-19352e462481 tempest-VolumesActionsTest-445676815 None] Lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" acquired by "attach_volume" :: waited 0.075s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-bfb31d7e-2933-466f-9877-19352e462481 tempest-VolumesActionsTest-445676815 None] Attaching volume e76ceeec-913e-4010-bd45-a09ed2b8e3a2 to instance d06e3b38-5213-4fb3-8ed8-656815e4b224 at mountpoint /dev/vdb on host None. Sep 25 10:44:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-bfb31d7e-2933-466f-9877-19352e462481 tempest-VolumesActionsTest-445676815 None] Attach volume completed successfully. Sep 25 10:44:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfb31d7e-2933-466f-9877-19352e462481 tempest-VolumesActionsTest-445676815 None] Lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" released by "attach_volume" :: held 0.186s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:59 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 25 10:44:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5" returned: 0 in 1.508s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:44:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:44:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e52fa228-030e-42e8-84be-a92a05b0089f tempest-VolumesActionsTest-445676815 None] Acquiring lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2-detach_volume" by "detach_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:44:59 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e23ca5b-b9f9-4b64-b31d-65e9baf8b3a4]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:44:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:44:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e52fa228-030e-42e8-84be-a92a05b0089f tempest-VolumesActionsTest-445676815 None] Lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:44:59 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e52fa228-030e-42e8-84be-a92a05b0089f tempest-VolumesActionsTest-445676815 None] Detaching volume e76ceeec-913e-4010-bd45-a09ed2b8e3a2 from instance d06e3b38-5213-4fb3-8ed8-656815e4b224. Sep 25 10:44:59 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e52fa228-030e-42e8-84be-a92a05b0089f tempest-VolumesActionsTest-445676815 None] Detach volume completed successfully. Sep 25 10:44:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e52fa228-030e-42e8-84be-a92a05b0089f tempest-VolumesActionsTest-445676815 None] Lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2-detach_volume" released by "detach_volume" :: held 0.165s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:44:59 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 Sep 25 10:44:59 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:01 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" returned: 0 in 1.890s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:01 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 Sep 25 10:45:01 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:02 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5" returned: 0 in 0.947s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:02 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5 Sep 25 10:45:02 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:02 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3.c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5" returned: 0 in 0.667s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5" released by "_delete_snapshot" :: held 5.322s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" released by "delete_snapshot" :: held 5.379s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Created reservations ['89c71c12-dd13-409f-9bd3-62413859af18', '84678785-e447-4b12-905c-89ed5fea581e', 'cf5e79ef-61d0-42de-9fd4-f12d8321e3fe', '5a525d6f-67c6-4f67-b318-8aa28bc53417'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:45:03 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Delete snapshot completed successfully. Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8bee95a6-fab4-42b2-903d-d58fa284e723 tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-c18d4fd6-ef8a-468e-9e5b-03dd9d09b5b5-delete_snapshot" released by "delete_snapshot" :: held 5.874s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:03 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:45:03 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" acquired by "delete_volume" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:04 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f663c2-0672-4ff4-bd61-49d7415ce9b7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:04 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.610s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:45:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:45:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:45:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:45:04 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 Sep 25 10:45:04 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:04 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" returned: 0 in 0.796s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:04 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3 Sep 25 10:45:04 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:05 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" returned: 0 in 0.599s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3" released by "delete_volume" :: held 1.582s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:05 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Created reservations ['3cfe017a-5432-4cd6-950c-a5532bd12e1b', '94dadf4b-3366-4576-b3b5-b969ce99431a', '94735ec2-2be4-450f-9928-264b53ba7683', 'e3c5e2d9-f884-40d5-b688-293c67e5a9ed'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:45:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:05 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:45:05 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:06 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 /opt/stack/data/cinder/conversion/1466e947-d683-4cab-aad5-1c007fe69622.temp_image.3b43876a-93f8-4855-b45b-55112a3bf2bfpoxgq19q.img" returned: 0 in 10.933s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[867ec7b8-a856-4897-aa67-89bbcf3a8d94]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:06 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-63541436-c73a-4874-abbc-f73769eea02a-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.427s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:45:06 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Deleted volume successfully. Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-63541436-c73a-4874-abbc-f73769eea02a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:06 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 Sep 25 10:45:06 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c2c18a3c-6d86-4808-9b06-1a027cbe4c8f tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-a12e5cbb-f7ec-4907-8e32-f774cf8fb3f3-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "cinder-quobyte-63541436-c73a-4874-abbc-f73769eea02a" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-63541436-c73a-4874-abbc-f73769eea02a" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4a2083-149a-4ff2-b711-048c7e885ed2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:06 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a Sep 25 10:45:06 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:06 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622" returned: 0 in 0.820s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622, size 1024.00 MB, duration 10.93 sec, destination /opt/stack/data/cinder/conversion/1466e947-d683-4cab-aad5-1c007fe69622.temp_image.3b43876a-93f8-4855-b45b-55112a3bf2bfpoxgq19q.img {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:45:06 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Converted 1024.00 MB image at 93.65 MB/s Sep 25 10:45:06 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] 3b43876a-93f8-4855-b45b-55112a3bf2bf was raw, no need to convert to raw {{(pid=87242) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 10:45:07 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a" returned: 0 in 0.543s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:07 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a Sep 25 10:45:07 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:07 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-63541436-c73a-4874-abbc-f73769eea02a" returned: 0 in 0.371s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-quobyte-63541436-c73a-4874-abbc-f73769eea02a" released by "delete_volume" :: held 1.049s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Created reservations ['bf4a2a61-782d-4db7-aef2-f97990a5f5a9', '9c7559f0-98f8-4c04-8739-a68760673ffc', '17aab532-6a14-45d1-bbdb-f1d817549f2c', '740891d6-3b3c-4e3f-9d11-bbb3f65a20b3'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:07 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:45:07 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:08 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.451s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:08 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:45:08 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Deleted volume successfully. Sep 25 10:45:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-48452c71-00ad-4831-a26a-6f7254265f4e tempest-VolumesSnapshotTestJSON-812185311 None] Lock "cinder-63541436-c73a-4874-abbc-f73769eea02a-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:17 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=87,cinder:INSERT=26,cinder:UPDATE=97,cinder:DELETE=6 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:45:18 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=31,cinder:UPDATE=34,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:45:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-208b2225-9bd8-4c3f-8674-ba005a81ca8d tempest-VolumesActionsTest-445676815 None] Acquiring lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" by "attach_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-208b2225-9bd8-4c3f-8674-ba005a81ca8d tempest-VolumesActionsTest-445676815 None] Lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" acquired by "attach_volume" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-208b2225-9bd8-4c3f-8674-ba005a81ca8d tempest-VolumesActionsTest-445676815 None] Attaching volume e76ceeec-913e-4010-bd45-a09ed2b8e3a2 to instance b5de707a-8f2c-47ff-be0d-0124f2871317 at mountpoint /dev/vdb on host None. Sep 25 10:45:19 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-208b2225-9bd8-4c3f-8674-ba005a81ca8d tempest-VolumesActionsTest-445676815 None] Attach volume completed successfully. Sep 25 10:45:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-208b2225-9bd8-4c3f-8674-ba005a81ca8d tempest-VolumesActionsTest-445676815 None] Lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" released by "attach_volume" :: held 0.223s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a1ff2c35-eaae-4863-8282-c18268394dea tempest-VolumesActionsTest-445676815 None] Acquiring lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2-detach_volume" by "detach_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a1ff2c35-eaae-4863-8282-c18268394dea tempest-VolumesActionsTest-445676815 None] Lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:19 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a1ff2c35-eaae-4863-8282-c18268394dea tempest-VolumesActionsTest-445676815 None] Detaching volume e76ceeec-913e-4010-bd45-a09ed2b8e3a2 from instance b5de707a-8f2c-47ff-be0d-0124f2871317. Sep 25 10:45:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a1ff2c35-eaae-4863-8282-c18268394dea tempest-VolumesActionsTest-445676815 None] Detach volume completed successfully. Sep 25 10:45:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a1ff2c35-eaae-4863-8282-c18268394dea tempest-VolumesActionsTest-445676815 None] Lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2-detach_volume" released by "detach_volume" :: held 0.324s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:30 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:INSERT=1,cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 43.447s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Uploaded volume to glance image-id: 3b43876a-93f8-4855-b45b-55112a3bf2bf. {{(pid=87242) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 39.074s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-924000456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2beb449-1a80-4bad-94b2-2ce61b56d1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d665820e5948758c80f6bd0df07efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:44:58Z,use_quota=True,user_id='208c06dc75c74f45bcfaad364bf77015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Creating volume a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:45:37 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:37 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-51b6c164-ef2c-4cba-a1ef-560b8aa6c803 tempest-TestImageHashVerification-87157306 None] Copy volume to image completed successfully. Sep 25 10:45:37 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 1073741824 Sep 25 10:45:37 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:37 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 1073741824" returned: 0 in 0.640s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:37 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 Sep 25 10:45:37 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:38 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" returned: 0 in 0.360s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 10.488s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db341359-d10d-4f9f-95d7-400280d2338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7032caa6-62c2-43fa-ab9c-236a55fd520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d31d473-a25f-48f2-bad7-b08d33b9cba1]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:38 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Volume volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 (a2beb449-1a80-4bad-94b2-2ce61b56d1e1): created successfully Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7032caa6-62c2-43fa-ab9c-236a55fd520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Flow 'volume_create_manager' (b38318b7-8497-445a-b736-3288232e37ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:45:38 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7d13988a-b706-436c-b6a6-bd252cfd133b tempest-VolumesSnapshotListTestJSON-1900897325 None] Created volume successfully. Sep 25 10:45:38 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 Sep 25 10:45:38 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:38 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" returned: 0 in 0.517s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c9da42-557f-4423-8ff3-8e436216a928]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:38 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 Sep 25 10:45:38 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Acquiring lock "cinder-1466e947-d683-4cab-aad5-1c007fe69622-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Lock "cinder-1466e947-d683-4cab-aad5-1c007fe69622-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Acquiring lock "cinder-quobyte-1466e947-d683-4cab-aad5-1c007fe69622" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Lock "cinder-quobyte-1466e947-d683-4cab-aad5-1c007fe69622" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8b894e-0254-4c4c-8224-d8408682a05f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:39 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" returned: 0 in 0.548s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.80ec9fff-eea6-4b97-8dc2-7d88619458879rxm8jcy.img {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:39 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 Sep 25 10:45:39 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:39 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.80ec9fff-eea6-4b97-8dc2-7d88619458879rxm8jcy.img Sep 25 10:45:39 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:39 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622" returned: 0 in 0.456s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:39 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622 Sep 25 10:45:39 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:40 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1466e947-d683-4cab-aad5-1c007fe69622" returned: 0 in 0.400s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Lock "cinder-quobyte-1466e947-d683-4cab-aad5-1c007fe69622" released by "delete_volume" :: held 0.939s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:40 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Created reservations ['1a39240c-b5ae-49d0-a660-5966dfea308b', '60dbabb3-57f3-4dd3-ab2a-52235da4b164', 'e981d025-4775-4d69-9c3d-59259b07059b', 'ab34c864-8519-4275-9800-e353e79745dd'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:45:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:45:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:45:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:45:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:45:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:45:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:40 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:45:40 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:41 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.762s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:41 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:45:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Deleted volume successfully. Sep 25 10:45:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2c5044f5-9e90-4964-a6ee-b671cf85bb9b tempest-TestImageHashVerification-87157306 None] Lock "cinder-1466e947-d683-4cab-aad5-1c007fe69622-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:45:49 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.80ec9fff-eea6-4b97-8dc2-7d88619458879rxm8jcy.img" returned: 0 in 9.791s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:49 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4454bf67-cc0f-4173-a057-13ef1d6e75a1]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:45:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:45:49 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 Sep 25 10:45:49 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:45:49 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 25 10:45:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" returned: 0 in 0.720s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:45:49 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2, size 1024.00 MB, duration 9.79 sec, destination /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.80ec9fff-eea6-4b97-8dc2-7d88619458879rxm8jcy.img {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:45:49 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Converted 1024.00 MB image at 104.55 MB/s Sep 25 10:45:49 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] 80ec9fff-eea6-4b97-8dc2-7d8861945887 was raw, no need to convert to raw {{(pid=87242) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 10:45:59 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:45:59 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=13,cinder:UPDATE=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:46:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:46:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:03 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:46:03 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:04 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.504s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Flow 'volume_create_manager' (2e123a94-6d03-4d84-8c73-67666a3952f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe9f220-bb60-4ca4-8d26-4666b67d0d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe9f220-bb60-4ca4-8d26-4666b67d0d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1007946723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a33efc-cb3a-4664-9a20-d60a49f0fde0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8449182ea8041508a83f8d89aa89f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:04Z,use_quota=True,user_id='82586bfa044b449b9df66bca33b68823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70536d6b-7496-4830-bb8a-70dcf51891a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70536d6b-7496-4830-bb8a-70dcf51891a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c1f440-ecd2-4319-a63c-094264f01ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c1f440-ecd2-4319-a63c-094264f01ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a33efc-cb3a-4664-9a20-d60a49f0fde0', 'volume_name': 'volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3806670-ae58-4e42-acec-51e2631d2773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3806670-ae58-4e42-acec-51e2631d2773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd57fde4-daed-4fb1-a0c7-2897a2fc47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:04 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Volume 16a33efc-cb3a-4664-9a20-d60a49f0fde0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0', 'volume_size': 1} Sep 25 10:46:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Flow 'volume_create_manager' (22edc72a-8415-4cc5-bde1-495536df547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3fca94-5832-45d4-a707-25fbd32f78af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3fca94-5832-45d4-a707-25fbd32f78af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1991550034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d89ed4-a61f-4d48-be60-78611fc0ff44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecb77ba67024db18b130e2a096adc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:08Z,use_quota=True,user_id='6661e628d0c14faab88fd725d8387d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdfdd16-3923-4806-8fd9-1935a05f20be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdfdd16-3923-4806-8fd9-1935a05f20be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d68a436-07e4-4087-8540-1b6bfd56ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d68a436-07e4-4087-8540-1b6bfd56ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d89ed4-a61f-4d48-be60-78611fc0ff44', 'volume_name': 'volume-84d89ed4-a61f-4d48-be60-78611fc0ff44', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948e4419-be5f-4906-83d2-19cd1f27ab34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948e4419-be5f-4906-83d2-19cd1f27ab34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfff6a7-3539-4bf3-977c-40e2b1ccaf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:08 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Volume 84d89ed4-a61f-4d48-be60-78611fc0ff44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d89ed4-a61f-4d48-be60-78611fc0ff44', 'volume_size': 1} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Flow 'volume_create_manager' (ea0dd28e-9679-4f46-a0b9-67aeaef32a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3247cc2-ec9b-46f9-a4c3-1541575982ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3247cc2-ec9b-46f9-a4c3-1541575982ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-815368793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1dc510-e8b1-45f6-82b0-9c716d6f595b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecb77ba67024db18b130e2a096adc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:09Z,use_quota=True,user_id='6661e628d0c14faab88fd725d8387d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3104d1-6b53-4e94-a7d4-96f6a45b02e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3104d1-6b53-4e94-a7d4-96f6a45b02e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d1bb04-a99b-4d6f-96b7-28bd35d6abf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d1bb04-a99b-4d6f-96b7-28bd35d6abf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1dc510-e8b1-45f6-82b0-9c716d6f595b', 'volume_name': 'volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62539652-b24d-4386-960e-9437921ab6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62539652-b24d-4386-960e-9437921ab6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976b22f1-9129-436f-ae88-f2630dfb2aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:08 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Volume 7c1dc510-e8b1-45f6-82b0-9c716d6f595b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b', 'volume_size': 1} Sep 25 10:46:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Flow 'volume_create_manager' (1b1ebea5-d80b-44cf-a368-bfa65758ea54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf6fea9-578c-42a2-8672-14703bcee97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf6fea9-578c-42a2-8672-14703bcee97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-178408805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87aa783f-af31-4e45-85d4-2ced960cb79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecb77ba67024db18b130e2a096adc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:09Z,use_quota=True,user_id='6661e628d0c14faab88fd725d8387d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7436be-16e2-4a32-a756-7d5dd83b86c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7436be-16e2-4a32-a756-7d5dd83b86c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697c72ee-9809-4077-acfc-3b7974853b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697c72ee-9809-4077-acfc-3b7974853b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87aa783f-af31-4e45-85d4-2ced960cb79a', 'volume_name': 'volume-87aa783f-af31-4e45-85d4-2ced960cb79a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1532113e-fbfb-474f-9489-b3da9108ab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1532113e-fbfb-474f-9489-b3da9108ab0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b5e659-41b9-4bf8-a1bc-210f8daa1bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:09 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Volume 87aa783f-af31-4e45-85d4-2ced960cb79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87aa783f-af31-4e45-85d4-2ced960cb79a', 'volume_size': 1} Sep 25 10:46:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Flow 'volume_create_manager' (0fda8c6a-d56d-4b48-8109-c2451889b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c9e416-457d-4b9c-8556-e6ecc64a5180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c9e416-457d-4b9c-8556-e6ecc64a5180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1963144020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d244d2-3f40-4c59-876f-525c0a21fb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecb77ba67024db18b130e2a096adc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:11Z,use_quota=True,user_id='6661e628d0c14faab88fd725d8387d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1f2355-68d7-4f1d-b238-99c18dcd1aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1f2355-68d7-4f1d-b238-99c18dcd1aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a43988-ee9a-483b-af68-0943555245eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a43988-ee9a-483b-af68-0943555245eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d244d2-3f40-4c59-876f-525c0a21fb3d', 'volume_name': 'volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7f35b1-f7b1-4342-91c0-2dc023da5e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7f35b1-f7b1-4342-91c0-2dc023da5e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e19cec-df97-49e6-b131-ce1e429fa01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:10 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Volume d7d244d2-3f40-4c59-876f-525c0a21fb3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d', 'volume_size': 1} Sep 25 10:46:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Flow 'volume_create_manager' (ce8817e6-f660-45c4-b9ad-450c8f96f76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8997fb16-0c67-4503-9a01-a8327622c0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8997fb16-0c67-4503-9a01-a8327622c0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-129406216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1233ced0-f747-4d02-a235-2a9266fd2d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecb77ba67024db18b130e2a096adc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:11Z,use_quota=True,user_id='6661e628d0c14faab88fd725d8387d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c84887-2892-43f9-a56f-72aafda375c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c84887-2892-43f9-a56f-72aafda375c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffa5990-3f8d-4525-90b9-7f4605edc391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffa5990-3f8d-4525-90b9-7f4605edc391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1233ced0-f747-4d02-a235-2a9266fd2d30', 'volume_name': 'volume-1233ced0-f747-4d02-a235-2a9266fd2d30', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a3d45a-0ec5-4036-a063-135787cd1d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a3d45a-0ec5-4036-a063-135787cd1d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cbf5aa-4889-479e-94fc-55a5e523bc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:11 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Volume 1233ced0-f747-4d02-a235-2a9266fd2d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1233ced0-f747-4d02-a235-2a9266fd2d30', 'volume_size': 1} Sep 25 10:46:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Uploaded volume to glance image-id: 80ec9fff-eea6-4b97-8dc2-7d8861945887. {{(pid=87242) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 10:46:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 41.205s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Creating offline snapshot 2fc85782-38ea-4a4a-9609-98baf922e99e of volume a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:46:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c1aef5a0-b6eb-474e-9349-968ba36652a0 tempest-VolumesActionsTest-445676815 None] Copy volume to image completed successfully. Sep 25 10:46:20 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[11133847-fd10-4c60-a901-4ee974330042]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:20 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 Sep 25 10:46:20 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:20 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" returned: 0 in 0.447s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:20 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e 1G Sep 25 10:46:20 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:21 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e 1G" returned: 0 in 0.515s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:21 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e Sep 25 10:46:21 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:21 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:46:21 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e" returned: 0 in 0.423s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:21 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e is being set with open permissions: ugo+rw Sep 25 10:46:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:21 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e Sep 25 10:46:21 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:22 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e" returned: 0 in 0.480s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:22 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.info Sep 25 10:46:22 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:22 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.info" returned: 0 in 0.383s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:22 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.info is being set with open permissions: ugo+rw Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:22 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.info Sep 25 10:46:22 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:22 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.info" returned: 0 in 0.282s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.687s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.292s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1007946723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a33efc-cb3a-4664-9a20-d60a49f0fde0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8449182ea8041508a83f8d89aa89f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:04Z,use_quota=True,user_id='82586bfa044b449b9df66bca33b68823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Creating volume 16a33efc-cb3a-4664-9a20-d60a49f0fde0 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:22 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:22 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 1073741824 Sep 25 10:46:22 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ac2b1b4d-042b-4c18-adbe-3933e9709958 tempest-VolumesSnapshotListTestJSON-1900897325 None] Create snapshot completed successfully Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:23 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 1073741824" returned: 0 in 0.589s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:23 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 Sep 25 10:46:23 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:23 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0" returned: 0 in 0.273s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.634s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1991550034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d89ed4-a61f-4d48-be60-78611fc0ff44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecb77ba67024db18b130e2a096adc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:08Z,use_quota=True,user_id='6661e628d0c14faab88fd725d8387d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Creating volume 84d89ed4-a61f-4d48-be60-78611fc0ff44 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:23 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd57fde4-daed-4fb1-a0c7-2897a2fc47e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf27a3c-3a47-4ec8-9637-0dcb1bbd5f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:23 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44 1073741824 Sep 25 10:46:23 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:23 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Volume volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 (16a33efc-cb3a-4664-9a20-d60a49f0fde0): created successfully Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf27a3c-3a47-4ec8-9637-0dcb1bbd5f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Flow 'volume_create_manager' (2e123a94-6d03-4d84-8c73-67666a3952f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-270c50ff-13ef-4ec7-b6d7-189042f42dfb tempest-TestStampPattern-1612230375 None] Created volume successfully. Sep 25 10:46:24 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44 1073741824" returned: 0 in 0.661s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:24 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44 Sep 25 10:46:24 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:24 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44" returned: 0 in 0.298s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.020s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-815368793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1dc510-e8b1-45f6-82b0-9c716d6f595b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecb77ba67024db18b130e2a096adc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:09Z,use_quota=True,user_id='6661e628d0c14faab88fd725d8387d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Creating volume 7c1dc510-e8b1-45f6-82b0-9c716d6f595b {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:24 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfff6a7-3539-4bf3-977c-40e2b1ccaf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d89ed4-a61f-4d48-be60-78611fc0ff44', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223bb2d3-dc62-4d41-a8b1-8dd8c09dcf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:25 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b 1073741824 Sep 25 10:46:25 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:25 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Volume volume-84d89ed4-a61f-4d48-be60-78611fc0ff44 (84d89ed4-a61f-4d48-be60-78611fc0ff44): created successfully Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223bb2d3-dc62-4d41-a8b1-8dd8c09dcf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Flow 'volume_create_manager' (22edc72a-8415-4cc5-bde1-495536df547f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:25 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3ec45698-9e68-4ef5-b864-14c5f75be331 tempest-CreateVolumesFromImageTest-1699306821 None] Created volume successfully. Sep 25 10:46:25 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b 1073741824" returned: 0 in 0.534s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:25 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b Sep 25 10:46:25 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:25 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b" returned: 0 in 0.309s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.154s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-178408805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87aa783f-af31-4e45-85d4-2ced960cb79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecb77ba67024db18b130e2a096adc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:09Z,use_quota=True,user_id='6661e628d0c14faab88fd725d8387d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Creating volume 87aa783f-af31-4e45-85d4-2ced960cb79a {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:25 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976b22f1-9129-436f-ae88-f2630dfb2aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e41c936-3b16-4b55-b407-027ae3a64b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:25 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a 1073741824 Sep 25 10:46:25 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:25 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Volume volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b (7c1dc510-e8b1-45f6-82b0-9c716d6f595b): created successfully Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e41c936-3b16-4b55-b407-027ae3a64b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Flow 'volume_create_manager' (ea0dd28e-9679-4f46-a0b9-67aeaef32a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:25 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-18e02c2c-9a4c-4394-981d-b0a2692f3e2b tempest-CreateVolumesFromImageTest-1699306821 None] Created volume successfully. Sep 25 10:46:26 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a 1073741824" returned: 0 in 0.551s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:26 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a Sep 25 10:46:26 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:26 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a" returned: 0 in 0.301s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.054s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1963144020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d244d2-3f40-4c59-876f-525c0a21fb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecb77ba67024db18b130e2a096adc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:11Z,use_quota=True,user_id='6661e628d0c14faab88fd725d8387d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Creating volume d7d244d2-3f40-4c59-876f-525c0a21fb3d {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:26 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:26 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d 1073741824 Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b5e659-41b9-4bf8-a1bc-210f8daa1bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87aa783f-af31-4e45-85d4-2ced960cb79a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:26 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d861bc-2751-42a0-a03a-cde3add0c1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:26 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Volume volume-87aa783f-af31-4e45-85d4-2ced960cb79a (87aa783f-af31-4e45-85d4-2ced960cb79a): created successfully Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d861bc-2751-42a0-a03a-cde3add0c1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Flow 'volume_create_manager' (1b1ebea5-d80b-44cf-a368-bfa65758ea54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:26 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2397fc9a-1603-42d5-a4b4-aec71babd743 tempest-CreateVolumesFromImageTest-1699306821 None] Created volume successfully. Sep 25 10:46:27 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d 1073741824" returned: 0 in 0.684s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:27 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d Sep 25 10:46:27 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:27 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d" returned: 0 in 0.342s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.323s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-129406216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1233ced0-f747-4d02-a235-2a9266fd2d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecb77ba67024db18b130e2a096adc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:11Z,use_quota=True,user_id='6661e628d0c14faab88fd725d8387d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Creating volume 1233ced0-f747-4d02-a235-2a9266fd2d30 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:27 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e19cec-df97-49e6-b131-ce1e429fa01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577c3f81-4aa5-45ee-a4e3-99547d62751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:27 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30 1073741824 Sep 25 10:46:27 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:27 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Volume volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d (d7d244d2-3f40-4c59-876f-525c0a21fb3d): created successfully Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577c3f81-4aa5-45ee-a4e3-99547d62751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Flow 'volume_create_manager' (0fda8c6a-d56d-4b48-8109-c2451889b770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:27 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6ea39e94-aef2-43fe-b733-8bc05de829e5 tempest-CreateVolumesFromImageTest-1699306821 None] Created volume successfully. Sep 25 10:46:28 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30 1073741824" returned: 0 in 0.546s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:28 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30 Sep 25 10:46:28 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:28 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30" returned: 0 in 0.320s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.481s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cbf5aa-4889-479e-94fc-55a5e523bc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1233ced0-f747-4d02-a235-2a9266fd2d30', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f30da5d-81ed-408a-b51c-86c495017e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[32adcbb4-2c26-4d7a-9624-920dda1aaa47]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:28 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Volume volume-1233ced0-f747-4d02-a235-2a9266fd2d30 (1233ced0-f747-4d02-a235-2a9266fd2d30): created successfully Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f30da5d-81ed-408a-b51c-86c495017e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Flow 'volume_create_manager' (ce8817e6-f660-45c4-b9ad-450c8f96f76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:28 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-75dba210-6c5e-4fdf-8dda-44f957d299c8 tempest-CreateVolumesFromImageTest-1699306821 None] Created volume successfully. Sep 25 10:46:29 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 Sep 25 10:46:29 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:29 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" returned: 0 in 0.447s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac9ac10-beec-4b59-a783-0ba781b67a3d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:29 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 Sep 25 10:46:29 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "cinder-1233ced0-f747-4d02-a235-2a9266fd2d30-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-1233ced0-f747-4d02-a235-2a9266fd2d30-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "cinder-quobyte-1233ced0-f747-4d02-a235-2a9266fd2d30" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-quobyte-1233ced0-f747-4d02-a235-2a9266fd2d30" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe22908-07ab-4b71-be90-5cbd19f51396]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:29 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" returned: 0 in 0.581s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:29 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img Sep 25 10:46:29 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:30 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30 Sep 25 10:46:30 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:30 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30" returned: 0 in 0.873s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:30 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30 Sep 25 10:46:30 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:31 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1233ced0-f747-4d02-a235-2a9266fd2d30" returned: 0 in 0.593s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-quobyte-1233ced0-f747-4d02-a235-2a9266fd2d30" released by "delete_volume" :: held 1.566s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:31 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Created reservations ['97977cd4-1b74-48ec-9b56-8ca93e796007', '3d97fdca-9692-4ae3-83ce-25cfdff8a8e8', '01573b7f-845c-4389-9eb1-d2311343ef4b', 'ad364b04-cc6b-40fe-a235-266c05f2e8fc'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:31 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:46:31 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "cinder-d7d244d2-3f40-4c59-876f-525c0a21fb3d-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-d7d244d2-3f40-4c59-876f-525c0a21fb3d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "cinder-quobyte-d7d244d2-3f40-4c59-876f-525c0a21fb3d" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-quobyte-d7d244d2-3f40-4c59-876f-525c0a21fb3d" acquired by "delete_volume" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:32 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[116abb0c-fc4d-49c2-8cf0-9084aac2c014]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:32 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.764s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:32 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:32 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Deleted volume successfully. Sep 25 10:46:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3ed563ed-c158-4651-8df4-03bc318012e8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-1233ced0-f747-4d02-a235-2a9266fd2d30-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:33 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d Sep 25 10:46:33 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:33 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d" returned: 0 in 1.219s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:33 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d Sep 25 10:46:33 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:34 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d7d244d2-3f40-4c59-876f-525c0a21fb3d" returned: 0 in 0.541s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-quobyte-d7d244d2-3f40-4c59-876f-525c0a21fb3d" released by "delete_volume" :: held 1.863s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Created reservations ['409302d9-758b-4be9-9073-d8fc5c1af885', '286ab1a5-0630-41b2-99f5-356fa685856f', '73101f1b-f3fb-4227-ba24-2d3c6539ead8', 'ad19cd0e-9011-49cb-9221-182d3ebf1486'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:34 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:46:34 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "cinder-87aa783f-af31-4e45-85d4-2ced960cb79a-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-87aa783f-af31-4e45-85d4-2ced960cb79a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "cinder-quobyte-87aa783f-af31-4e45-85d4-2ced960cb79a" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-quobyte-87aa783f-af31-4e45-85d4-2ced960cb79a" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:35 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[99188e01-fc5f-4603-a0d5-ae01d9c72286]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:35 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.559s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:35 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Deleted volume successfully. Sep 25 10:46:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-098218e8-1c20-4cd7-990d-06b5712032ac tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-d7d244d2-3f40-4c59-876f-525c0a21fb3d-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:35 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a Sep 25 10:46:35 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:36 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a" returned: 0 in 0.908s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:36 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a Sep 25 10:46:36 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:36 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-87aa783f-af31-4e45-85d4-2ced960cb79a" returned: 0 in 0.519s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-quobyte-87aa783f-af31-4e45-85d4-2ced960cb79a" released by "delete_volume" :: held 1.554s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Created reservations ['6bf09e0e-7244-4af4-b733-87dc52641311', '61afc41a-41f6-409f-a640-86a052cf02b3', 'cb4485ca-8539-41af-9170-137d93ea2504', '26ba761d-9b76-469e-a0be-b90bca6ef3e6'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:36 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:46:36 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "cinder-7c1dc510-e8b1-45f6-82b0-9c716d6f595b-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:37 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-7c1dc510-e8b1-45f6-82b0-9c716d6f595b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.647s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:37 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:37 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Deleted volume successfully. Sep 25 10:46:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "cinder-quobyte-7c1dc510-e8b1-45f6-82b0-9c716d6f595b" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30ee7f29-7998-4129-b634-ee1607dbb16c tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-87aa783f-af31-4e45-85d4-2ced960cb79a-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-quobyte-7c1dc510-e8b1-45f6-82b0-9c716d6f595b" acquired by "delete_volume" :: waited 0.053s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:37 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b862337-08f5-4496-a67d-6c654982b128]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:38 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b Sep 25 10:46:38 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:38 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img" returned: 0 in 8.893s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[639e310e-f7ec-4ad7-b4dc-aa5dac176fb9]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:38 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b" returned: 0 in 1.164s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:38 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b Sep 25 10:46:38 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:38 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 Sep 25 10:46:38 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:39 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c1dc510-e8b1-45f6-82b0-9c716d6f595b" returned: 0 in 0.416s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-quobyte-7c1dc510-e8b1-45f6-82b0-9c716d6f595b" released by "delete_volume" :: held 1.689s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Created reservations ['dde0bd58-00d4-42e1-a3c8-aa59d277d7f6', '4ca02732-6a2c-4ef4-856f-3eb61a70ce41', '0bc37a62-533a-427b-93f8-dd389743c278', 'e6cc0e52-a085-4e54-acd4-d549c472be6c'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:39 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" returned: 0 in 0.734s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:46:39 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Converted 1024.00 MB image at 115.12 MB/s Sep 25 10:46:39 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] cb8b8d5c-b3f0-44b3-b58e-16d6da51811b was raw, converting to qcow2 {{(pid=87242) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 10:46:39 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[916e84b5-718c-4fef-a3ba-67822d0092ca]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:39 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img Sep 25 10:46:39 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "cinder-84d89ed4-a61f-4d48-be60-78611fc0ff44-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:39 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.327s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:39 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Deleted volume successfully. Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-84d89ed4-a61f-4d48-be60-78611fc0ff44-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-294daba2-77c3-47d2-b49b-34d3e5169676 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-7c1dc510-e8b1-45f6-82b0-9c716d6f595b-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "cinder-quobyte-84d89ed4-a61f-4d48-be60-78611fc0ff44" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-quobyte-84d89ed4-a61f-4d48-be60-78611fc0ff44" acquired by "delete_volume" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:40 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img" returned: 0 in 0.447s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[447fef75-9eec-4d66-a814-637f83881a0e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:40 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img Sep 25 10:46:40 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:40 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44 Sep 25 10:46:40 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:40 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img" returned: 1 in 0.397s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img /opt/stack/data/cinder/conversion/vol_upload_xq4di_gk {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:40 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img /opt/stack/data/cinder/conversion/vol_upload_xq4di_gk Sep 25 10:46:40 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:40 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44" returned: 0 in 0.535s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:40 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44 Sep 25 10:46:40 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:40 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img /opt/stack/data/cinder/conversion/vol_upload_xq4di_gk" returned: 0 in 0.350s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Image conversion details: src /opt/stack/data/cinder/conversion/e76ceeec-913e-4010-bd45-a09ed2b8e3a2.temp_image.cb8b8d5c-b3f0-44b3-b58e-16d6da51811b_p4nepzz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_xq4di_gk {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:46:40 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e96ded-efd5-4313-9135-a0f32d70ef51]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xq4di_gk {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:40 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-84d89ed4-a61f-4d48-be60-78611fc0ff44" returned: 0 in 0.326s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-quobyte-84d89ed4-a61f-4d48-be60-78611fc0ff44" released by "delete_volume" :: held 0.938s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:41 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xq4di_gk Sep 25 10:46:41 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Created reservations ['24a86142-f52a-49bb-9504-a352f0d63c60', '319a7f60-6992-48b1-9e62-4240a93d148d', '0d06ab68-459b-4ce4-a3cb-9ac2353a0f82', '6f3a1ade-26d9-4e9f-a173-7607e6a54b4a'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:41 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:46:41 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:41 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xq4di_gk" returned: 0 in 0.515s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:41 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.277s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Deleted volume successfully. Sep 25 10:46:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f1910b6a-b801-4ee8-b98d-314e9ad500f8 tempest-CreateVolumesFromImageTest-1699306821 None] Lock "cinder-84d89ed4-a61f-4d48-be60-78611fc0ff44-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.817s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Uploaded volume to glance image-id: cb8b8d5c-b3f0-44b3-b58e-16d6da51811b. {{(pid=87242) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 10:46:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 20.255s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] Creating offline snapshot 00a25600-b351-42ee-afb2-37cf3536f50d of volume a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:46:43 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3db856ca-6e78-4c4d-be7d-3cdbfdd2fa2c tempest-VolumesActionsTest-445676815 None] Copy volume to image completed successfully. Sep 25 10:46:43 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d854a-3437-44ef-986f-43294fbf1796]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:43 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e Sep 25 10:46:43 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:44 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e" returned: 0 in 0.666s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:46:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:44 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d 1G Sep 25 10:46:44 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-ddc4501a-f13b-41da-b424-b1febf103352 req-8176b2a7-da19-4cbe-b41e-fa9973551e59 tempest-TestStampPattern-1612230375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Acquiring lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Acquiring lock "cinder-quobyte-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Lock "cinder-quobyte-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" acquired by "delete_volume" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:44 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6abc68-11ff-493f-83f1-794a3e43daec]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:45 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 Sep 25 10:46:45 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:45 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d 1G" returned: 0 in 0.820s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:45 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d Sep 25 10:46:45 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:45 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" returned: 0 in 0.559s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:45 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2 Sep 25 10:46:45 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:45 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d" returned: 0 in 0.462s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:45 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d is being set with open permissions: ugo+rw Sep 25 10:46:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:45 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d Sep 25 10:46:45 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:45 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" returned: 0 in 0.397s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Lock "cinder-quobyte-e76ceeec-913e-4010-bd45-a09ed2b8e3a2" released by "delete_volume" :: held 1.025s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Created reservations ['cd6649bd-ac22-4790-8efe-d2956953f2fa', '430d2c19-4b60-414f-84cc-e32ce9232744', '71baf657-d04a-4609-add5-169d6762499e', '7a149dd1-2692-4a24-8044-b3277d8ace85'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:46 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-ddc4501a-f13b-41da-b424-b1febf103352 req-8176b2a7-da19-4cbe-b41e-fa9973551e59 tempest-TestStampPattern-1612230375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.567s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-ddc4501a-f13b-41da-b424-b1febf103352 req-8176b2a7-da19-4cbe-b41e-fa9973551e59 tempest-TestStampPattern-1612230375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:46 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ba0c1024-b808-4003-8d14-ba8f0a9da5f8 tempest-VolumesSnapshotListTestJSON-1900897325 None] Create snapshot completed successfully Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:46 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:46:46 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-ddc4501a-f13b-41da-b424-b1febf103352 req-8176b2a7-da19-4cbe-b41e-fa9973551e59 tempest-TestStampPattern-1612230375 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b77b26e1-2c4b-419e-aa08-dce73b9731b3', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:46:46 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-ddc4501a-f13b-41da-b424-b1febf103352 req-8176b2a7-da19-4cbe-b41e-fa9973551e59 tempest-TestStampPattern-1612230375 None] attachment_update completed successfully. Sep 25 10:46:46 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.390s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:46:46 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Deleted volume successfully. Sep 25 10:46:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-113e6851-cd8a-4c5d-92e2-a95965632f3c tempest-VolumesActionsTest-445676815 None] Lock "cinder-e76ceeec-913e-4010-bd45-a09ed2b8e3a2-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] Creating offline snapshot 2a6bf89e-936e-4df6-aaf4-e91a42b20d49 of volume a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (bffb5f51-243e-405c-9cf4-0c9e638c4e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f572e4c4-70d3-4481-a08a-80866ebefe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb07440-739f-4888-843d-ce62e07ba2ec]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f572e4c4-70d3-4481-a08a-80866ebefe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2110725704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91463251-3e2e-4895-bd06-c054e3510977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:48Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d5ea83-dba7-4ab9-8610-d3589bd92971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d5ea83-dba7-4ab9-8610-d3589bd92971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bd0cbc-12cb-467e-8eee-47a7d42ea029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bd0cbc-12cb-467e-8eee-47a7d42ea029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91463251-3e2e-4895-bd06-c054e3510977', 'volume_name': 'volume-91463251-3e2e-4895-bd06-c054e3510977', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6936be-d622-4ad5-94a2-b3d355b85772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6936be-d622-4ad5-94a2-b3d355b85772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dda4d3-1786-4ba6-8e4f-882ec95d848e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:47 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume 91463251-3e2e-4895-bd06-c054e3510977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91463251-3e2e-4895-bd06-c054e3510977', 'volume_size': 1} Sep 25 10:46:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:48 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d Sep 25 10:46:48 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:48 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d" returned: 0 in 0.514s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:46:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:48 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 1G Sep 25 10:46:48 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:49 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 1G" returned: 0 in 0.743s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:49 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 Sep 25 10:46:49 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:49 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49" returned: 0 in 0.401s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:49 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 is being set with open permissions: ugo+rw Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:49 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 Sep 25 10:46:49 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:49 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49" returned: 0 in 0.398s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2110725704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91463251-3e2e-4895-bd06-c054e3510977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:48Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Creating volume 91463251-3e2e-4895-bd06-c054e3510977 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:49 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:50 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977 1073741824 Sep 25 10:46:50 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ddf6f846-59ea-4014-8af0-b5334e586dab tempest-VolumesSnapshotListTestJSON-1900897325 None] Create snapshot completed successfully Sep 25 10:46:50 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977 1073741824" returned: 0 in 0.641s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:50 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977 Sep 25 10:46:50 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:51 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977" returned: 0 in 0.498s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dda4d3-1786-4ba6-8e4f-882ec95d848e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91463251-3e2e-4895-bd06-c054e3510977', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a39b3ac-ace9-4758-b65b-150947bfddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:51 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume volume-91463251-3e2e-4895-bd06-c054e3510977 (91463251-3e2e-4895-bd06-c054e3510977): created successfully Sep 25 10:46:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a39b3ac-ace9-4758-b65b-150947bfddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (bffb5f51-243e-405c-9cf4-0c9e638c4e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:51 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3489f532-36a3-4ed0-a92b-c7742bdb886e tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created volume successfully. Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-2a6bf89e-936e-4df6-aaf4-e91a42b20d49-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-2a6bf89e-936e-4df6-aaf4-e91a42b20d49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-quobyte-2a6bf89e-936e-4df6-aaf4-e91a42b20d49" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-2a6bf89e-936e-4df6-aaf4-e91a42b20d49" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Deleting offline snapshot 2a6bf89e-936e-4df6-aaf4-e91a42b20d49 of volume a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] snapshot_file for this snap is: volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (66c25893-1838-4bf1-b3ce-19cecfc8b185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100e6969-ae4c-44bc-ba2c-7a2b4c3803de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4db9ea-657f-46fb-96d0-659534241079]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100e6969-ae4c-44bc-ba2c-7a2b4c3803de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-678298304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41809fd9-1424-418c-8fe2-f26ee45c23c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:52Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138f4e70-b03a-4235-9faa-75e6f0c1f8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138f4e70-b03a-4235-9faa-75e6f0c1f8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08ab400-3d97-4edc-9b36-81e75d36296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08ab400-3d97-4edc-9b36-81e75d36296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41809fd9-1424-418c-8fe2-f26ee45c23c9', 'volume_name': 'volume-41809fd9-1424-418c-8fe2-f26ee45c23c9', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbffcde-efb5-49d7-8585-82df025e57a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbffcde-efb5-49d7-8585-82df025e57a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdc041a-7465-46a2-87b9-c6f22bcf0f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:52 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume 41809fd9-1424-418c-8fe2-f26ee45c23c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41809fd9-1424-418c-8fe2-f26ee45c23c9', 'volume_size': 1} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-678298304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41809fd9-1424-418c-8fe2-f26ee45c23c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:52Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Creating volume 41809fd9-1424-418c-8fe2-f26ee45c23c9 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:52 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:52 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 Sep 25 10:46:52 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:52 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9 1073741824 Sep 25 10:46:52 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (a72db3a3-dc75-4eda-ad54-d3e3463cc7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044c6447-70f6-4c7b-8eb2-49fdc4cd44bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044c6447-70f6-4c7b-8eb2-49fdc4cd44bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1300805343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21810936-a0c4-4923-97ae-a944eeb63df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:53Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84347d57-6c32-4a70-8a2e-b44807f05553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84347d57-6c32-4a70-8a2e-b44807f05553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0db6d5-0e33-4ba5-984f-2404abd5f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0db6d5-0e33-4ba5-984f-2404abd5f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21810936-a0c4-4923-97ae-a944eeb63df9', 'volume_name': 'volume-21810936-a0c4-4923-97ae-a944eeb63df9', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2b0e63-59c0-4823-8333-02c352e358f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2b0e63-59c0-4823-8333-02c352e358f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a540702-be04-47a7-b6d4-8f3441575314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:53 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume 21810936-a0c4-4923-97ae-a944eeb63df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21810936-a0c4-4923-97ae-a944eeb63df9', 'volume_size': 1} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:53 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49" returned: 0 in 1.039s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0223294a-b55a-45cb-ada8-a8c06617aa53]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:53 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9 1073741824" returned: 0 in 1.030s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:54 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d Sep 25 10:46:54 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (c982f356-503f-4a0a-894f-ef8c6fbe9315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456f9389-7f92-4038-b466-1a9e3cffd48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:54 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9 Sep 25 10:46:54 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456f9389-7f92-4038-b466-1a9e3cffd48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442548853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048e10fa-8065-4b17-a460-d2ae3f6f009f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:54Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42cd776-dc56-4a62-949e-adaa680e4ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42cd776-dc56-4a62-949e-adaa680e4ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9459f542-7a7b-4192-9d4d-81d49be373cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9459f542-7a7b-4192-9d4d-81d49be373cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048e10fa-8065-4b17-a460-d2ae3f6f009f', 'volume_name': 'volume-048e10fa-8065-4b17-a460-d2ae3f6f009f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2328697-fc28-487c-9720-a0fb935e741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2328697-fc28-487c-9720-a0fb935e741a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f24e79-1fd6-45b5-919d-b6cde5578249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume 048e10fa-8065-4b17-a460-d2ae3f6f009f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048e10fa-8065-4b17-a460-d2ae3f6f009f', 'volume_size': 1} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (6be08e43-b97b-4488-b341-4adc3f3fc4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7308c7f-d856-41e3-b9f1-08f92f5f6bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7308c7f-d856-41e3-b9f1-08f92f5f6bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-197660801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9766caa-30fa-4ff9-aae6-713700ccf4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:54Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991a72ee-64bd-43f5-be66-1818c0600b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:54 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991a72ee-64bd-43f5-be66-1818c0600b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f68ede-3432-4c06-bd4b-aab321400c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f68ede-3432-4c06-bd4b-aab321400c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9766caa-30fa-4ff9-aae6-713700ccf4a8', 'volume_name': 'volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c753f2e-8171-4219-8900-5e8bfb8b7e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c753f2e-8171-4219-8900-5e8bfb8b7e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01013f44-d1ca-47a8-8cba-7ff1d0b7fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume a9766caa-30fa-4ff9-aae6-713700ccf4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8', 'volume_size': 1} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9" returned: 0 in 0.549s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d" returned: 0 in 0.904s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1300805343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21810936-a0c4-4923-97ae-a944eeb63df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:53Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Creating volume 21810936-a0c4-4923-97ae-a944eeb63df9 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:54 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:54 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 Sep 25 10:46:54 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:54 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9 1073741824 Sep 25 10:46:54 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdc041a-7465-46a2-87b9-c6f22bcf0f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41809fd9-1424-418c-8fe2-f26ee45c23c9', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b942ad1a-ff7f-4dee-9dad-3ac20fe4de2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:54 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume volume-41809fd9-1424-418c-8fe2-f26ee45c23c9 (41809fd9-1424-418c-8fe2-f26ee45c23c9): created successfully Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b942ad1a-ff7f-4dee-9dad-3ac20fe4de2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (66c25893-1838-4bf1-b3ce-19cecfc8b185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:54 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d716414f-b53f-4459-b797-294a96463e70 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created volume successfully. Sep 25 10:46:54 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-258905a1-f4d4-4188-8002-e4a6a6a01ac9 req-54f892e3-49ec-4de8-9f8b-002755a40033 tempest-TestStampPattern-1612230375 None] Terminate volume connection completed successfully. Sep 25 10:46:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-258905a1-f4d4-4188-8002-e4a6a6a01ac9 req-54f892e3-49ec-4de8-9f8b-002755a40033 tempest-TestStampPattern-1612230375 None] Deleting attachment b77b26e1-2c4b-419e-aa08-dce73b9731b3. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (78d1e48f-4a94-481d-b3c1-409729530a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740c3a78-293a-4817-9f2e-3bb577e871ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740c3a78-293a-4817-9f2e-3bb577e871ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1350152237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=797ef50b-86bf-444b-8020-50277600c344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:55Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43cb412-b515-4f42-bf11-68afc0c7c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43cb412-b515-4f42-bf11-68afc0c7c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3a5636-8ff9-45e0-9966-46519fd8dd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3a5636-8ff9-45e0-9966-46519fd8dd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '797ef50b-86bf-444b-8020-50277600c344', 'volume_name': 'volume-797ef50b-86bf-444b-8020-50277600c344', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ed74a2-031e-44c7-a23e-f151e3bd1533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ed74a2-031e-44c7-a23e-f151e3bd1533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d662a05d-f148-4aa0-89df-cebbabdf7e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:55 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume 797ef50b-86bf-444b-8020-50277600c344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-797ef50b-86bf-444b-8020-50277600c344', 'volume_size': 1} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:55 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9 1073741824" returned: 0 in 0.860s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:55 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9 Sep 25 10:46:55 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:55 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49" returned: 0 in 1.004s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:55 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49 Sep 25 10:46:55 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:55 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9" returned: 0 in 0.335s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442548853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048e10fa-8065-4b17-a460-d2ae3f6f009f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:54Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:55 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Creating volume 048e10fa-8065-4b17-a460-d2ae3f6f009f {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:55 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2a6bf89e-936e-4df6-aaf4-e91a42b20d49" returned: 0 in 0.312s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:56 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f 1073741824 Sep 25 10:46:56 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a540702-be04-47a7-b6d4-8f3441575314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21810936-a0c4-4923-97ae-a944eeb63df9', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f305e8f-e8b0-4f3b-81f9-99627c26b24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-2a6bf89e-936e-4df6-aaf4-e91a42b20d49" released by "_delete_snapshot" :: held 3.567s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:56 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume volume-21810936-a0c4-4923-97ae-a944eeb63df9 (21810936-a0c4-4923-97ae-a944eeb63df9): created successfully Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f305e8f-e8b0-4f3b-81f9-99627c26b24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (a72db3a3-dc75-4eda-ad54-d3e3463cc7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" released by "delete_snapshot" :: held 3.621s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c8543600-058f-428a-a65e-b32365f59b89 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created volume successfully. Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Created reservations ['c231a1aa-d4cf-48d7-bc94-df30e989e004', 'e85657b0-a6d3-40ba-a197-36dc42754bd1', '0978748d-8792-46a6-98f2-10c762cd82e4', '47e05ca1-9a8e-45c1-8615-78302e3dcdd1'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Delete snapshot completed successfully. Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2f68ae8-6d11-47ff-8ef1-a129f16eef51 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-2a6bf89e-936e-4df6-aaf4-e91a42b20d49-delete_snapshot" released by "delete_snapshot" :: held 3.867s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:56 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f 1073741824" returned: 0 in 0.660s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:56 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f Sep 25 10:46:56 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-00a25600-b351-42ee-afb2-37cf3536f50d-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-00a25600-b351-42ee-afb2-37cf3536f50d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-quobyte-00a25600-b351-42ee-afb2-37cf3536f50d" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-00a25600-b351-42ee-afb2-37cf3536f50d" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:46:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Deleting offline snapshot 00a25600-b351-42ee-afb2-37cf3536f50d of volume a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] snapshot_file for this snap is: volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6315fb28-e36d-49f7-aeba-8b4b3f241bec]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:57 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f" returned: 0 in 0.456s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.499s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-197660801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9766caa-30fa-4ff9-aae6-713700ccf4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:54Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Creating volume a9766caa-30fa-4ff9-aae6-713700ccf4a8 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:57 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f24e79-1fd6-45b5-919d-b6cde5578249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048e10fa-8065-4b17-a460-d2ae3f6f009f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79d6275-796a-41f2-a3ed-d72cc3611553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:57 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8 1073741824 Sep 25 10:46:57 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:57 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume volume-048e10fa-8065-4b17-a460-d2ae3f6f009f (048e10fa-8065-4b17-a460-d2ae3f6f009f): created successfully Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79d6275-796a-41f2-a3ed-d72cc3611553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:57 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d Sep 25 10:46:57 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (c982f356-503f-4a0a-894f-ef8c6fbe9315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:57 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5fe026cf-747c-4b0f-a10a-adc586fa7471 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created volume successfully. Sep 25 10:46:57 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d" returned: 0 in 0.609s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34b31f8-e92f-482c-a9d8-2e8500fe951e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:57 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e Sep 25 10:46:57 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:57 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8 1073741824" returned: 0 in 0.714s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:58 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8 Sep 25 10:46:58 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:58 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e" returned: 0 in 0.462s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:58 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d Sep 25 10:46:58 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:58 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8" returned: 0 in 0.325s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.744s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1350152237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=797ef50b-86bf-444b-8020-50277600c344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2d45c2a3534ed4bfd9784c1ca8915b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:46:55Z,use_quota=True,user_id='a55846e4a30040e087634dd3953537fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Creating volume 797ef50b-86bf-444b-8020-50277600c344 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:46:58 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01013f44-d1ca-47a8-8cba-7ff1d0b7fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:58 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344 1073741824 Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56200d02-a4c5-4ff8-915a-fac5c966a923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:58 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:58 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8 (a9766caa-30fa-4ff9-aae6-713700ccf4a8): created successfully Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56200d02-a4c5-4ff8-915a-fac5c966a923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (6be08e43-b97b-4488-b341-4adc3f3fc4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7ca59c2c-d3cf-44f8-b50c-3b167aea1346 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created volume successfully. Sep 25 10:46:58 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d" returned: 0 in 0.582s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:58 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d Sep 25 10:46:58 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:59 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344 1073741824" returned: 0 in 0.724s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:59 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344 Sep 25 10:46:59 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:46:59 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.00a25600-b351-42ee-afb2-37cf3536f50d" returned: 0 in 0.421s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-00a25600-b351-42ee-afb2-37cf3536f50d" released by "_delete_snapshot" :: held 2.287s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" released by "delete_snapshot" :: held 2.336s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Created reservations ['b940ea68-b350-4690-93b6-a23b5e97fdb9', '94fb158a-04f8-45aa-b866-f8b278518084', '9dbdf5d2-7b19-42c3-89ef-f85bb66cd9dc', '9dc93493-08ed-4f36-90e8-2282fbc7f246'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:46:59 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 25 10:46:59 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Delete snapshot completed successfully. Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344" returned: 0 in 0.378s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-56afb571-836e-40a7-b24b-edd949af2d70 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-00a25600-b351-42ee-afb2-37cf3536f50d-delete_snapshot" released by "delete_snapshot" :: held 2.598s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.690s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d662a05d-f148-4aa0-89df-cebbabdf7e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-797ef50b-86bf-444b-8020-50277600c344', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca81185-70d9-4a45-b4c2-0fc9d3bb5a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Creating offline snapshot 7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 of volume 16a33efc-cb3a-4664-9a20-d60a49f0fde0 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:46:59 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Volume volume-797ef50b-86bf-444b-8020-50277600c344 (797ef50b-86bf-444b-8020-50277600c344): created successfully Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca81185-70d9-4a45-b4c2-0fc9d3bb5a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Flow 'volume_create_manager' (78d1e48f-4a94-481d-b3c1-409729530a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9de8ca6-fd51-4199-9310-aab9b0750d59]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:46:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:46:59 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8b97ddaf-f9b5-4eb7-802b-d9db8c8f5249 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created volume successfully. Sep 25 10:46:59 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 Sep 25 10:46:59 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:00 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-2fc85782-38ea-4a4a-9609-98baf922e99e-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0" returned: 0 in 0.566s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-2fc85782-38ea-4a4a-9609-98baf922e99e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-quobyte-2fc85782-38ea-4a4a-9609-98baf922e99e" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:00 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 1G Sep 25 10:47:00 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-2fc85782-38ea-4a4a-9609-98baf922e99e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Deleting offline snapshot 2fc85782-38ea-4a4a-9609-98baf922e99e of volume a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] snapshot_file for this snap is: volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-797ef50b-86bf-444b-8020-50277600c344-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[061636e9-5cf4-4287-9633-8ceb0c64aa03]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-797ef50b-86bf-444b-8020-50277600c344-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=102,cinder:SELECT=84,cinder:INSERT=16,cinder:DELETE=8 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-quobyte-797ef50b-86bf-444b-8020-50277600c344" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-797ef50b-86bf-444b-8020-50277600c344" acquired by "delete_volume" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb0e80b-03da-423d-ae0f-393902412e1f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:00 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e Sep 25 10:47:00 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:00 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344 Sep 25 10:47:00 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:00 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 1G" returned: 0 in 0.804s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:00 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e" returned: 0 in 0.657s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:47:00 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 Sep 25 10:47:00 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[742f39e2-3693-4144-bc84-9fe90d868435]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:01 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 Sep 25 10:47:01 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:01 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344" returned: 0 in 0.787s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:01 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344 Sep 25 10:47:01 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:01 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174" returned: 0 in 0.480s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:01 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 is being set with open permissions: ugo+rw Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:01 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 Sep 25 10:47:01 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:01 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" returned: 0 in 0.595s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:01 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e Sep 25 10:47:01 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:01 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-797ef50b-86bf-444b-8020-50277600c344" returned: 0 in 0.429s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-797ef50b-86bf-444b-8020-50277600c344" released by "delete_volume" :: held 1.308s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created reservations ['c7c70bf9-e173-42d1-bc1a-f01cc9b274da', 'e948b448-198c-4315-a19e-d331b0d3215f', '0b3f8497-01cc-49e2-87d3-9138254265f1', '32aa7bbb-6a61-4b5a-9559-2ecbb686383b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:01 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174" returned: 0 in 0.438s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:01 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.info Sep 25 10:47:01 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:02 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:02 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:02 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e" returned: 0 in 0.569s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:02 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e Sep 25 10:47:02 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:02 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.info" returned: 0 in 0.427s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:02 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.info is being set with open permissions: ugo+rw Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:02 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.info Sep 25 10:47:02 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:02 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.413s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:02 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Deleted volume successfully. Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-924c3c71-fa0f-49b9-8377-2c8d5eb5a93c tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-797ef50b-86bf-444b-8020-50277600c344-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:02 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1.2fc85782-38ea-4a4a-9609-98baf922e99e" returned: 0 in 0.441s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-2fc85782-38ea-4a4a-9609-98baf922e99e" released by "_delete_snapshot" :: held 2.497s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" released by "delete_snapshot" :: held 2.529s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-a9766caa-30fa-4ff9-aae6-713700ccf4a8-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:02 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-a9766caa-30fa-4ff9-aae6-713700ccf4a8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.info" returned: 0 in 0.431s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.323s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:02 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7c33c533-ff56-4252-913a-0dc7e622814a tempest-TestStampPattern-1612230375 None] Create snapshot completed successfully Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-quobyte-a9766caa-30fa-4ff9-aae6-713700ccf4a8" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Created reservations ['43a3ea77-4458-4b44-a78d-1ee423933b92', '56eb9bd7-4b87-410c-b59b-e7fa70591a5f', '6efcdadc-9965-4610-a13f-1ab07a464da1', '5f225017-8566-4eaf-8701-17704f66655b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-a9766caa-30fa-4ff9-aae6-713700ccf4a8" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ef86e4-1c49-48e6-96fc-ecbbf1e6400b]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:03 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Delete snapshot completed successfully. Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-20d234b7-b364-4b6f-8370-feb4b72e5d3a tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-2fc85782-38ea-4a4a-9609-98baf922e99e-delete_snapshot" released by "delete_snapshot" :: held 2.949s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:03 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8 Sep 25 10:47:03 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:03 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:03 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-a2beb449-1a80-4bad-94b2-2ce61b56d1e1-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:03 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8" returned: 0 in 0.646s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-a2beb449-1a80-4bad-94b2-2ce61b56d1e1-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:03 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8 Sep 25 10:47:03 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" acquired by "delete_volume" :: waited 0.048s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:03 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.442s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cf1009-8c7d-4278-9101-b8d027024601]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:04 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 Sep 25 10:47:04 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:04 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a9766caa-30fa-4ff9-aae6-713700ccf4a8" returned: 0 in 0.514s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-a9766caa-30fa-4ff9-aae6-713700ccf4a8" released by "delete_volume" :: held 1.244s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created reservations ['179ff386-6d2d-4e50-acee-7a54525794ec', '8faa44e5-830d-4cb7-a62c-87f405957002', 'a9b28798-f178-4145-95ec-ed8bf20d7f33', '859c1fce-7c42-49ae-99dd-889a6a701c7b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:04 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:04 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:04 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" returned: 0 in 0.697s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:04 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1 Sep 25 10:47:04 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:04 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.451s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Deleted volume successfully. Sep 25 10:47:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-11048af3-f1c2-453f-82b2-4bf2054dec60 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-a9766caa-30fa-4ff9-aae6-713700ccf4a8-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:05 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" returned: 0 in 0.528s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-048e10fa-8065-4b17-a460-d2ae3f6f009f-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-quobyte-a2beb449-1a80-4bad-94b2-2ce61b56d1e1" released by "delete_volume" :: held 1.380s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-048e10fa-8065-4b17-a460-d2ae3f6f009f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-quobyte-048e10fa-8065-4b17-a460-d2ae3f6f009f" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Created reservations ['0ce92008-7648-48a0-bd42-de621f280697', '0fb24440-2141-4338-bdb9-a43c0da2be8f', 'b123a546-8004-4d99-871f-c8b32baec8e1', '3b980d2f-3286-453b-b6f3-92c8b6b5b0bc'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-048e10fa-8065-4b17-a460-d2ae3f6f009f" acquired by "delete_volume" :: waited 0.041s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5542988c-7218-4a84-beed-b4f876b56b06]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:05 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f Sep 25 10:47:05 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:05 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:05 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:05 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.366s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:06 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:06 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Deleted volume successfully. Sep 25 10:47:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a7800dce-295a-474a-b550-d4549da708d1 tempest-VolumesSnapshotListTestJSON-1900897325 None] Lock "cinder-a2beb449-1a80-4bad-94b2-2ce61b56d1e1-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:06 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f" returned: 0 in 0.763s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:06 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f Sep 25 10:47:06 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:06 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-048e10fa-8065-4b17-a460-d2ae3f6f009f" returned: 0 in 0.408s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-048e10fa-8065-4b17-a460-d2ae3f6f009f" released by "delete_volume" :: held 1.264s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:06 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created reservations ['6a976609-241a-4a95-962f-a571e41477ec', '8481a10f-d260-44ef-85fb-e7ccaa3dfac5', '62a16f0c-79b4-4499-b87c-c311ae70c589', '2a56a414-e8fd-4341-b76a-82d3318403e6'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:07 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:07 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:07 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.583s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Deleted volume successfully. Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c7a939c-8795-4266-9f85-323e64327d33 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-048e10fa-8065-4b17-a460-d2ae3f6f009f-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-21810936-a0c4-4923-97ae-a944eeb63df9-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-21810936-a0c4-4923-97ae-a944eeb63df9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-quobyte-21810936-a0c4-4923-97ae-a944eeb63df9" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-21810936-a0c4-4923-97ae-a944eeb63df9" acquired by "delete_volume" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:08 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1369f2-48d8-450c-b06f-0ddf9854e32c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:08 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9 Sep 25 10:47:08 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:08 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9" returned: 0 in 0.675s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:08 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9 Sep 25 10:47:08 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:09 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-21810936-a0c4-4923-97ae-a944eeb63df9" returned: 0 in 0.506s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-21810936-a0c4-4923-97ae-a944eeb63df9" released by "delete_volume" :: held 1.323s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:09 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created reservations ['3e534bf8-be7e-4597-a557-60e49b83a465', '85164033-46e1-4dc9-93b3-e68f350a3fdb', 'd3fcf349-ab5d-4f0a-8228-7e20819a63a3', '34c57e70-9051-4137-ad77-94bb6746b993'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:09 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:09 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:10 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.413s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:10 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:10 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Deleted volume successfully. Sep 25 10:47:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-250264e3-37bf-4b34-afb3-f9993403ca18 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-21810936-a0c4-4923-97ae-a944eeb63df9-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-41809fd9-1424-418c-8fe2-f26ee45c23c9-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-41809fd9-1424-418c-8fe2-f26ee45c23c9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-quobyte-41809fd9-1424-418c-8fe2-f26ee45c23c9" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-41809fd9-1424-418c-8fe2-f26ee45c23c9" acquired by "delete_volume" :: waited 0.035s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:10 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a049f4e-edac-4f5d-b5f1-c0285a08dd56]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:10 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9 Sep 25 10:47:10 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:11 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9" returned: 0 in 0.604s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:11 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9 Sep 25 10:47:11 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:11 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-41809fd9-1424-418c-8fe2-f26ee45c23c9" returned: 0 in 0.473s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-41809fd9-1424-418c-8fe2-f26ee45c23c9" released by "delete_volume" :: held 1.168s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created reservations ['c231509a-63b1-4244-b128-9eab0c90acca', '9c2509f9-5b87-44d5-b4aa-c3cd47dc164b', '4a755c9c-955d-4b58-9e35-5558b54e196e', 'bbbbf9cd-1e1c-4475-8f12-decd76531142'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:11 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:11 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:12 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.437s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:12 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:12 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Deleted volume successfully. Sep 25 10:47:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f361e1a8-5fda-4fca-bf41-fe11075ddae2 tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-41809fd9-1424-418c-8fe2-f26ee45c23c9-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-91463251-3e2e-4895-bd06-c054e3510977-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-91463251-3e2e-4895-bd06-c054e3510977-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "cinder-quobyte-91463251-3e2e-4895-bd06-c054e3510977" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-91463251-3e2e-4895-bd06-c054e3510977" acquired by "delete_volume" :: waited 0.054s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:12 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69e4f99-a284-466b-861a-d09e4fbda180]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:13 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977 Sep 25 10:47:13 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:13 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977" returned: 0 in 0.739s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:13 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977 Sep 25 10:47:13 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:14 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-91463251-3e2e-4895-bd06-c054e3510977" returned: 0 in 0.435s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-quobyte-91463251-3e2e-4895-bd06-c054e3510977" released by "delete_volume" :: held 1.297s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Created reservations ['3134f43c-66ec-4f3f-81a9-600470073a9f', '8dc31671-2af0-44ee-962d-d7b97b6115e1', 'ce3da3ae-c7fa-44b8-a0b0-848d34e7a338', 'db68c1e9-8d70-4255-ab6f-bd12e9f6d637'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:14 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:14 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:14 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.509s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:14 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:14 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Deleted volume successfully. Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f4c30b3b-04e1-4923-bbfd-3be799c329cd tempest-CreateVolumesFromSourceVolumeTest-2095998654 None] Lock "cinder-91463251-3e2e-4895-bd06-c054e3510977-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Flow 'volume_create_manager' (0991216d-fe58-413f-82d2-ce4450170840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0179d182-51e8-4a1b-aba7-a9066d0fede6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0179d182-51e8-4a1b-aba7-a9066d0fede6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1737953016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4647819-7573-48ef-bf92-e404f8e72a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8449182ea8041508a83f8d89aa89f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:16Z,use_quota=True,user_id='82586bfa044b449b9df66bca33b68823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc0aaa0-3da5-4515-8995-1b3226dbeee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc0aaa0-3da5-4515-8995-1b3226dbeee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0e437b-a983-46c0-a899-f3a631d62e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0e437b-a983-46c0-a899-f3a631d62e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4647819-7573-48ef-bf92-e404f8e72a61', 'volume_name': 'volume-d4647819-7573-48ef-bf92-e404f8e72a61', 'volume_size': 1, 'snapshot_id': '7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878b2078-3dc6-4ff2-a31a-8af82456a0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878b2078-3dc6-4ff2-a31a-8af82456a0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d36b64-2d77-47a6-bfed-eaef213c5e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:16 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Volume d4647819-7573-48ef-bf92-e404f8e72a61: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4647819-7573-48ef-bf92-e404f8e72a61', 'volume_size': 1, 'snapshot_id': '7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174'} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Acquiring lock "cinder-quobyte-7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174-d4647819-7573-48ef-bf92-e404f8e72a61" by "_create_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174-d4647819-7573-48ef-bf92-e404f8e72a61" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Creating volume d4647819-7573-48ef-bf92-e404f8e72a61 from snapshot 7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 {{(pid=87242) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Acquiring lock "cinder-quobyte-d4647819-7573-48ef-bf92-e404f8e72a61" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-d4647819-7573-48ef-bf92-e404f8e72a61" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] snapshot: 7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174, volume: d4647819-7573-48ef-bf92-e404f8e72a61, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce586e07-152c-4162-9d29-0286c0cf79d3]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:16 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 Sep 25 10:47:16 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:16 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174" returned: 0 in 0.597s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac23ef4-fd95-4086-a99c-6661144d9185]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:16 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 Sep 25 10:47:16 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:17 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0" returned: 0 in 0.755s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:47:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:47:17 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:47:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:17 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 Sep 25 10:47:17 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:26 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=117,cinder:INSERT=48,cinder:DELETE=15,cinder:UPDATE=159 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:47:26 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=46,cinder:INSERT=14,cinder:UPDATE=66,cinder:DELETE=6 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Flow 'volume_create_manager' (5f07a195-8724-4a65-81bd-fca731a8c220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2ef37a-4ce1-4b2f-a373-7f0f2f196e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2ef37a-4ce1-4b2f-a373-7f0f2f196e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424515771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc135b6-0f47-435e-bd40-18fccb89dcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7385b45e7947bdb0c6f352f8d39e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:28Z,use_quota=True,user_id='f5dbe72178ab43cea4b9b82aabf93ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d611e6-1f36-4451-a5eb-b6f03c923829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d611e6-1f36-4451-a5eb-b6f03c923829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ef803a-0212-46b8-9393-6559f6f78515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ef803a-0212-46b8-9393-6559f6f78515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc135b6-0f47-435e-bd40-18fccb89dcf1', 'volume_name': 'volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1887c324-b89b-4bc9-9073-4b49e012f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1887c324-b89b-4bc9-9073-4b49e012f36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a34534-e926-4832-95f2-8c0cc88faa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:28 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Volume 3dc135b6-0f47-435e-bd40-18fccb89dcf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1', 'volume_size': 1} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:28 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61" returned: 0 in 11.221s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0, size 1024.00 MB, duration 11.22 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:47:28 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Converted 1024.00 MB image at 91.25 MB/s Sep 25 10:47:28 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 is being set with open permissions: ugo+rw Sep 25 10:47:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:28 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 Sep 25 10:47:28 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:29 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61" returned: 0 in 0.419s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-d4647819-7573-48ef-bf92-e404f8e72a61" released by "_copy_volume_from_snapshot" :: held 13.129s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174-d4647819-7573-48ef-bf92-e404f8e72a61" released by "_create_volume_from_snapshot" :: held 13.242s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.270s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424515771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc135b6-0f47-435e-bd40-18fccb89dcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7385b45e7947bdb0c6f352f8d39e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:28Z,use_quota=True,user_id='f5dbe72178ab43cea4b9b82aabf93ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Creating volume 3dc135b6-0f47-435e-bd40-18fccb89dcf1 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:29 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:29 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1 1073741824 Sep 25 10:47:29 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d36b64-2d77-47a6-bfed-eaef213c5e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4647819-7573-48ef-bf92-e404f8e72a61', 'volume_size': 1, 'snapshot_id': '7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a872a5e-442e-490d-a680-9413afb8fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:29 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Volume volume-d4647819-7573-48ef-bf92-e404f8e72a61 (d4647819-7573-48ef-bf92-e404f8e72a61): created successfully Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a872a5e-442e-490d-a680-9413afb8fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Flow 'volume_create_manager' (0991216d-fe58-413f-82d2-ce4450170840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:29 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4eb7fc62-e02a-4018-8eff-b75e79f7ff9a tempest-TestStampPattern-1612230375 None] Created volume successfully. Sep 25 10:47:30 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1 1073741824" returned: 0 in 0.696s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:30 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1 Sep 25 10:47:30 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:30 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1" returned: 0 in 0.290s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:47:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a34534-e926-4832-95f2-8c0cc88faa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02592e8a-f5e1-4169-b3f1-d4e3224f0d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:30 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Volume volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1 (3dc135b6-0f47-435e-bd40-18fccb89dcf1): created successfully Sep 25 10:47:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02592e8a-f5e1-4169-b3f1-d4e3224f0d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Flow 'volume_create_manager' (5f07a195-8724-4a65-81bd-fca731a8c220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-562315be-b17b-42fc-ae80-d74c6b4d01ff tempest-ProjectReaderTests-865097158 None] Created volume successfully. Sep 25 10:47:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Acquiring lock "cinder-3dc135b6-0f47-435e-bd40-18fccb89dcf1-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Lock "cinder-3dc135b6-0f47-435e-bd40-18fccb89dcf1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Acquiring lock "cinder-quobyte-3dc135b6-0f47-435e-bd40-18fccb89dcf1" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Lock "cinder-quobyte-3dc135b6-0f47-435e-bd40-18fccb89dcf1" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:32 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fd93d1-51ed-4d0c-8d39-b981a9fc974e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:32 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1 Sep 25 10:47:32 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:33 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1" returned: 0 in 0.843s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:33 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1 Sep 25 10:47:33 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:33 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dc135b6-0f47-435e-bd40-18fccb89dcf1" returned: 0 in 0.412s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Lock "cinder-quobyte-3dc135b6-0f47-435e-bd40-18fccb89dcf1" released by "delete_volume" :: held 1.346s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Created reservations ['7e7fc7d3-5855-49fe-8716-57787e03dc60', '3a950d49-7b4c-4896-ba08-c7b1fddc8d77', '397aa1e3-7d5c-4e4f-87fe-71970dbae0cd', 'c4c33f80-2bf0-4b07-846c-13907d35f8b0'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:33 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:33 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:34 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.380s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:34 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:34 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Deleted volume successfully. Sep 25 10:47:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-75c6a6cb-73dd-4193-9a2a-3fa0365214ee tempest-ProjectReaderTests-865097158 None] Lock "cinder-3dc135b6-0f47-435e-bd40-18fccb89dcf1-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Flow 'volume_create_manager' (35252719-2609-473b-a30b-bec6e9d9063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db922b4d-cea7-4288-bc6f-42ed19a4633d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db922b4d-cea7-4288-bc6f-42ed19a4633d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180013458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942c45b8-90de-4cbe-af8d-2b6c84dbcedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7385b45e7947bdb0c6f352f8d39e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:36Z,use_quota=True,user_id='f5dbe72178ab43cea4b9b82aabf93ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eadd36d5-aa64-47b6-bf0a-d14a5e380c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eadd36d5-aa64-47b6-bf0a-d14a5e380c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e7caf1-d24a-4235-85f4-7e35ea5e1cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e7caf1-d24a-4235-85f4-7e35ea5e1cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942c45b8-90de-4cbe-af8d-2b6c84dbcedb', 'volume_name': 'volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4985b5e8-2b4c-4481-b568-490357d907e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4985b5e8-2b4c-4481-b568-490357d907e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44f8c33-133b-42ed-a327-8bebb6c96da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:36 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Volume 942c45b8-90de-4cbe-af8d-2b6c84dbcedb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb', 'volume_size': 1} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180013458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942c45b8-90de-4cbe-af8d-2b6c84dbcedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7385b45e7947bdb0c6f352f8d39e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:36Z,use_quota=True,user_id='f5dbe72178ab43cea4b9b82aabf93ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Creating volume 942c45b8-90de-4cbe-af8d-2b6c84dbcedb {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:36 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:47:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:36 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb 1073741824 Sep 25 10:47:36 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:37 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb 1073741824" returned: 0 in 0.966s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:37 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb Sep 25 10:47:37 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:37 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb" returned: 0 in 0.593s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:47:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44f8c33-133b-42ed-a327-8bebb6c96da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a88a4d-2a6f-4f9e-9293-57b2eac7e374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:38 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Volume volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb (942c45b8-90de-4cbe-af8d-2b6c84dbcedb): created successfully Sep 25 10:47:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a88a4d-2a6f-4f9e-9293-57b2eac7e374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Flow 'volume_create_manager' (35252719-2609-473b-a30b-bec6e9d9063b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:38 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-40c1d66e-ae13-48e6-ad39-efc1cea4e498 tempest-ProjectReaderTests-865097158 None] Created volume successfully. Sep 25 10:47:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Acquiring lock "cinder-942c45b8-90de-4cbe-af8d-2b6c84dbcedb-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Lock "cinder-942c45b8-90de-4cbe-af8d-2b6c84dbcedb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Acquiring lock "cinder-quobyte-942c45b8-90de-4cbe-af8d-2b6c84dbcedb" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Lock "cinder-quobyte-942c45b8-90de-4cbe-af8d-2b6c84dbcedb" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:39 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6079d8fb-2e05-4e1c-a6ed-239446ac3684]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:39 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb Sep 25 10:47:39 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:40 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb" returned: 0 in 0.567s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:40 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb Sep 25 10:47:40 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:40 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-942c45b8-90de-4cbe-af8d-2b6c84dbcedb" returned: 0 in 0.378s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Lock "cinder-quobyte-942c45b8-90de-4cbe-af8d-2b6c84dbcedb" released by "delete_volume" :: held 1.050s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Created reservations ['dc5261f9-b6aa-4520-8d5a-f33e55889635', 'ae414c94-671d-4566-a0f7-6781c2e5b84e', '05321283-bd48-4076-88b8-92bef57ac9fe', '6c96ed29-874d-4cba-aa3f-de773fa224f1'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:40 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:40 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:41 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.375s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:41 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Deleted volume successfully. Sep 25 10:47:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c2711e-4294-48b9-bb7b-3364f8474460 tempest-ProjectReaderTests-865097158 None] Lock "cinder-942c45b8-90de-4cbe-af8d-2b6c84dbcedb-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:50 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=16,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=24,cinder:SELECT=15,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Flow 'volume_create_manager' (5bcb392a-6225-4deb-8b9b-93e8a679e952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b879e2-281c-4848-b74b-768aefa38c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b879e2-281c-4848-b74b-768aefa38c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1884146546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784aeb84-0469-4d61-8540-6c98dbfd71bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed6c121568942518c313b48a2896b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:52Z,use_quota=True,user_id='a43c13aa0a8b4ee9b8d9883f62f9a020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebe1ca8-95ee-44a2-adbb-092619721375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebe1ca8-95ee-44a2-adbb-092619721375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9b5252-7fc2-4036-af4e-be9711039710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9b5252-7fc2-4036-af4e-be9711039710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '784aeb84-0469-4d61-8540-6c98dbfd71bd', 'volume_name': 'volume-784aeb84-0469-4d61-8540-6c98dbfd71bd', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac40748-4d76-4525-9dc4-4a8cd7b3bd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac40748-4d76-4525-9dc4-4a8cd7b3bd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab30b32-0cc0-470e-907b-1c60b2d8e9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:51 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Volume 784aeb84-0469-4d61-8540-6c98dbfd71bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-784aeb84-0469-4d61-8540-6c98dbfd71bd', 'volume_size': 1} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1884146546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784aeb84-0469-4d61-8540-6c98dbfd71bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed6c121568942518c313b48a2896b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:52Z,use_quota=True,user_id='a43c13aa0a8b4ee9b8d9883f62f9a020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Creating volume 784aeb84-0469-4d61-8540-6c98dbfd71bd {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:51 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:47:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:51 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd 1073741824 Sep 25 10:47:51 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:52 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd 1073741824" returned: 0 in 0.810s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:52 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd Sep 25 10:47:52 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:53 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd" returned: 0 in 0.477s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:47:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab30b32-0cc0-470e-907b-1c60b2d8e9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784aeb84-0469-4d61-8540-6c98dbfd71bd', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca08a728-644f-4e45-99e7-4ff70f7e237e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:53 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Volume volume-784aeb84-0469-4d61-8540-6c98dbfd71bd (784aeb84-0469-4d61-8540-6c98dbfd71bd): created successfully Sep 25 10:47:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca08a728-644f-4e45-99e7-4ff70f7e237e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Flow 'volume_create_manager' (5bcb392a-6225-4deb-8b9b-93e8a679e952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-141cfbd8-9a95-4b19-8aeb-4ff00c8e3a8e tempest-ProjectReaderTests-371684202 None] Created volume successfully. Sep 25 10:47:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Acquiring lock "cinder-784aeb84-0469-4d61-8540-6c98dbfd71bd-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Lock "cinder-784aeb84-0469-4d61-8540-6c98dbfd71bd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Acquiring lock "cinder-quobyte-784aeb84-0469-4d61-8540-6c98dbfd71bd" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:47:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Lock "cinder-quobyte-784aeb84-0469-4d61-8540-6c98dbfd71bd" acquired by "delete_volume" :: waited 0.064s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:47:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f2aca2-5bbf-424b-957c-60bf7133ff5f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:47:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:54 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd Sep 25 10:47:54 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:54 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd" returned: 0 in 0.519s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:54 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd Sep 25 10:47:54 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:55 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-784aeb84-0469-4d61-8540-6c98dbfd71bd" returned: 0 in 0.667s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Lock "cinder-quobyte-784aeb84-0469-4d61-8540-6c98dbfd71bd" released by "delete_volume" :: held 1.298s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:55 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Created reservations ['64781d89-a0b0-489e-a251-8907c2ac35d1', '28dc6a83-994e-4df4-86a3-a0f665149ba0', '5b955382-3093-44e8-baf9-9766deda9286', 'dddf94be-82cd-4f10-b88a-56c6b0ee8ff0'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:47:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:56 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:47:56 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:56 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.892s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:56 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:47:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Deleted volume successfully. Sep 25 10:47:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-52c9b9e4-5982-479b-8564-991eff4115b4 tempest-ProjectReaderTests-371684202 None] Lock "cinder-784aeb84-0469-4d61-8540-6c98dbfd71bd-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Flow 'volume_create_manager' (3916ec77-b020-4293-9f8c-9ce9046ba632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135fc51c-bf96-4033-b59b-f721f42b8483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135fc51c-bf96-4033-b59b-f721f42b8483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1704764163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4c8793-791d-49a6-9781-c8b60b89ef96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed6c121568942518c313b48a2896b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:58Z,use_quota=True,user_id='a43c13aa0a8b4ee9b8d9883f62f9a020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57edad69-f0fa-4be5-860e-31a86ba31e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57edad69-f0fa-4be5-860e-31a86ba31e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c0b4f1-b88a-4046-9861-b869419bde63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c0b4f1-b88a-4046-9861-b869419bde63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f4c8793-791d-49a6-9781-c8b60b89ef96', 'volume_name': 'volume-5f4c8793-791d-49a6-9781-c8b60b89ef96', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa46c78-2701-46e7-aa48-8146dc7a421a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa46c78-2701-46e7-aa48-8146dc7a421a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28dc7f2-0ef4-4571-9a11-4fbb44f55d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:47:58 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Volume 5f4c8793-791d-49a6-9781-c8b60b89ef96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f4c8793-791d-49a6-9781-c8b60b89ef96', 'volume_size': 1} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1704764163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4c8793-791d-49a6-9781-c8b60b89ef96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed6c121568942518c313b48a2896b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:47:58Z,use_quota=True,user_id='a43c13aa0a8b4ee9b8d9883f62f9a020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Creating volume 5f4c8793-791d-49a6-9781-c8b60b89ef96 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:47:58 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:47:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:58 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96 1073741824 Sep 25 10:47:58 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:47:59 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Sep 25 10:47:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96 1073741824" returned: 0 in 1.321s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:47:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:47:59 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96 Sep 25 10:47:59 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:00 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96" returned: 0 in 0.741s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:00 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:48:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28dc7f2-0ef4-4571-9a11-4fbb44f55d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f4c8793-791d-49a6-9781-c8b60b89ef96', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a3ca77-6dfe-4b51-a7a2-5faa19c05d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:00 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Volume volume-5f4c8793-791d-49a6-9781-c8b60b89ef96 (5f4c8793-791d-49a6-9781-c8b60b89ef96): created successfully Sep 25 10:48:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a3ca77-6dfe-4b51-a7a2-5faa19c05d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Flow 'volume_create_manager' (3916ec77-b020-4293-9f8c-9ce9046ba632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:00 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-066b7bb4-ee27-4623-a32a-96768914f660 tempest-ProjectReaderTests-371684202 None] Created volume successfully. Sep 25 10:48:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Acquiring lock "cinder-5f4c8793-791d-49a6-9781-c8b60b89ef96-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Lock "cinder-5f4c8793-791d-49a6-9781-c8b60b89ef96-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Acquiring lock "cinder-quobyte-5f4c8793-791d-49a6-9781-c8b60b89ef96" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Lock "cinder-quobyte-5f4c8793-791d-49a6-9781-c8b60b89ef96" acquired by "delete_volume" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:01 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e9aaf3-ef54-41b3-b88c-e1f329a4b134]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:02 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96 Sep 25 10:48:02 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:02 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96" returned: 0 in 0.788s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:02 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96 Sep 25 10:48:02 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:03 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5f4c8793-791d-49a6-9781-c8b60b89ef96" returned: 0 in 0.491s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Lock "cinder-quobyte-5f4c8793-791d-49a6-9781-c8b60b89ef96" released by "delete_volume" :: held 1.390s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Created reservations ['913186bf-ba2f-4f5e-ae31-b678d1583496', '281ab458-c38a-4f03-82a9-3cbbe45d9cd0', '2ef8fb96-9468-463c-a2b5-f5f63c6fee86', '9ee8a457-bda6-45f2-8a06-0c2bbb72d470'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:03 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:48:03 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:03 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:48:03 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:04 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.620s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:48:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:48:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:48:04 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.605s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Deleted volume successfully. Sep 25 10:48:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5ced92ba-3976-4b46-a317-64af255c9863 tempest-ProjectReaderTests-371684202 None] Lock "cinder-5f4c8793-791d-49a6-9781-c8b60b89ef96-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Flow 'volume_create_manager' (df314254-7bc2-44f8-b492-8176c951dc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65bc690f-49cc-4119-a1bd-c0427c4e284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65bc690f-49cc-4119-a1bd-c0427c4e284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581216716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1147c6b4-6734-488d-9c85-95a83f108565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed6c121568942518c313b48a2896b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:06Z,use_quota=True,user_id='a43c13aa0a8b4ee9b8d9883f62f9a020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee31780-9d2d-49a0-b172-29e85de2a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee31780-9d2d-49a0-b172-29e85de2a24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec2cab8-1ca1-48bb-8eb3-770530c31f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec2cab8-1ca1-48bb-8eb3-770530c31f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1147c6b4-6734-488d-9c85-95a83f108565', 'volume_name': 'volume-1147c6b4-6734-488d-9c85-95a83f108565', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e442f5-8e5d-4f2a-a8b9-c795be5af88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e442f5-8e5d-4f2a-a8b9-c795be5af88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e496a6d3-f162-44b2-9327-b1e606824c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:05 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Volume 1147c6b4-6734-488d-9c85-95a83f108565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1147c6b4-6734-488d-9c85-95a83f108565', 'volume_size': 1} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581216716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1147c6b4-6734-488d-9c85-95a83f108565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed6c121568942518c313b48a2896b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:06Z,use_quota=True,user_id='a43c13aa0a8b4ee9b8d9883f62f9a020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Creating volume 1147c6b4-6734-488d-9c85-95a83f108565 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:05 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:48:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:06 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565 1073741824 Sep 25 10:48:06 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:07 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565 1073741824" returned: 0 in 1.400s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:07 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565 Sep 25 10:48:07 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:08 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565" returned: 0 in 0.740s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:48:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e496a6d3-f162-44b2-9327-b1e606824c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1147c6b4-6734-488d-9c85-95a83f108565', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5dfbc0-2f0c-4d43-b1cd-09c9f17ea760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:08 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Volume volume-1147c6b4-6734-488d-9c85-95a83f108565 (1147c6b4-6734-488d-9c85-95a83f108565): created successfully Sep 25 10:48:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5dfbc0-2f0c-4d43-b1cd-09c9f17ea760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Flow 'volume_create_manager' (df314254-7bc2-44f8-b492-8176c951dc5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:08 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-49d401bf-0700-44fe-93d0-5ef1ffde4d73 tempest-ProjectReaderTests-371684202 None] Created volume successfully. Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Acquiring lock "cinder-1147c6b4-6734-488d-9c85-95a83f108565-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Lock "cinder-1147c6b4-6734-488d-9c85-95a83f108565-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Acquiring lock "cinder-quobyte-1147c6b4-6734-488d-9c85-95a83f108565" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Lock "cinder-quobyte-1147c6b4-6734-488d-9c85-95a83f108565" acquired by "delete_volume" :: waited 0.036s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8cc7e5-5e98-4413-9fb7-982f227dcca8]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:09 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565 Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Flow 'volume_create_manager' (51561b67-50ee-4ec4-832f-3a5b4826e964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:09 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249481e4-fcd9-4279-a15f-131ec01c0c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249481e4-fcd9-4279-a15f-131ec01c0c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-21954099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6780cb-5d70-43b7-87ad-6e46a6d7f903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8280110e7a8146d892ae5f434d42273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:09Z,use_quota=True,user_id='b92a3443489e4959b7448f77808f424f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d1edb81-18b5-45e5-85b0-c0401999a614),volume_type_id=4d1edb81-18b5-45e5-85b0-c0401999a614)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a70db4-9459-46ee-83b0-5d9e0ed0fd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a70db4-9459-46ee-83b0-5d9e0ed0fd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62b20a1-863e-4bf1-9980-2019de16f377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62b20a1-863e-4bf1-9980-2019de16f377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6780cb-5d70-43b7-87ad-6e46a6d7f903', 'volume_name': 'volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6848c8d2-c884-491a-a13b-0605857654fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6848c8d2-c884-491a-a13b-0605857654fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71174669-b7fc-49c7-a7c2-9a4cd13e0ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:09 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Volume 8f6780cb-5d70-43b7-87ad-6e46a6d7f903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903', 'volume_size': 1} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-21954099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6780cb-5d70-43b7-87ad-6e46a6d7f903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8280110e7a8146d892ae5f434d42273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:09Z,use_quota=True,user_id='b92a3443489e4959b7448f77808f424f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d1edb81-18b5-45e5-85b0-c0401999a614),volume_type_id=4d1edb81-18b5-45e5-85b0-c0401999a614)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Creating volume 8f6780cb-5d70-43b7-87ad-6e46a6d7f903 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:09 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:48:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:09 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903 1073741824 Sep 25 10:48:09 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:10 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565" returned: 0 in 0.757s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:10 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565 Sep 25 10:48:10 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Flow 'volume_create_manager' (e9da68ab-66e0-4638-ad6b-5362fb986198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23be3198-632b-4d71-9004-95e645b63f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23be3198-632b-4d71-9004-95e645b63f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1601142700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7961798c-f0c7-457a-89e7-af53d32a4f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8280110e7a8146d892ae5f434d42273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:10Z,use_quota=True,user_id='b92a3443489e4959b7448f77808f424f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec195797-d885-4bd5-948f-7fab413416b0),volume_type_id=ec195797-d885-4bd5-948f-7fab413416b0)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b39b7a-78d0-484a-bfc0-4b2407d9396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b39b7a-78d0-484a-bfc0-4b2407d9396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbb0a96-7f0a-4043-a859-f316877b390e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbb0a96-7f0a-4043-a859-f316877b390e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7961798c-f0c7-457a-89e7-af53d32a4f45', 'volume_name': 'volume-7961798c-f0c7-457a-89e7-af53d32a4f45', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa89834-ce45-42ff-93ab-cbd1893cd3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa89834-ce45-42ff-93ab-cbd1893cd3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348a864a-321f-46ed-95bf-005a3ef865d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:10 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Volume 7961798c-f0c7-457a-89e7-af53d32a4f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7961798c-f0c7-457a-89e7-af53d32a4f45', 'volume_size': 1} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:10 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1147c6b4-6734-488d-9c85-95a83f108565" returned: 0 in 0.662s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:10 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903 1073741824" returned: 0 in 1.054s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Lock "cinder-quobyte-1147c6b4-6734-488d-9c85-95a83f108565" released by "delete_volume" :: held 1.502s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:10 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903 Sep 25 10:48:10 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Created reservations ['e69acec5-336d-4aae-99f4-14f5874c8d20', '34c80add-897f-4b98-8da8-050c8fa6836f', '9e1e00f9-684f-4aa2-963a-94d56cca204d', '2a17ca2d-7ccf-43b6-9a08-2ae29b236321'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:11 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:48:11 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:11 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903" returned: 0 in 0.383s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1601142700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7961798c-f0c7-457a-89e7-af53d32a4f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8280110e7a8146d892ae5f434d42273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:10Z,use_quota=True,user_id='b92a3443489e4959b7448f77808f424f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec195797-d885-4bd5-948f-7fab413416b0),volume_type_id=ec195797-d885-4bd5-948f-7fab413416b0)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Creating volume 7961798c-f0c7-457a-89e7-af53d32a4f45 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:11 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:11 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45 1073741824 Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71174669-b7fc-49c7-a7c2-9a4cd13e0ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:11 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335b95af-8fcb-48ea-88bf-ada37319dba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:11 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Volume volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903 (8f6780cb-5d70-43b7-87ad-6e46a6d7f903): created successfully Sep 25 10:48:11 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335b95af-8fcb-48ea-88bf-ada37319dba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Flow 'volume_create_manager' (51561b67-50ee-4ec4-832f-3a5b4826e964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.384s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Deleted volume successfully. Sep 25 10:48:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2e767592-20cc-4d02-ae18-ced077d8a4b6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Created volume successfully. Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9926a8d2-4391-42ac-b038-12a1acf2e950 tempest-ProjectReaderTests-371684202 None] Lock "cinder-1147c6b4-6734-488d-9c85-95a83f108565-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Flow 'volume_create_manager' (ae71c632-b4be-4114-ab53-9bbc78a501d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b8ceb2-e60c-4ea9-93fb-62e6550dc664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b8ceb2-e60c-4ea9-93fb-62e6550dc664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2087148938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0fe7fe-f83f-4057-8391-88555685a212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8280110e7a8146d892ae5f434d42273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:11Z,use_quota=True,user_id='b92a3443489e4959b7448f77808f424f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914a70e9-e46c-407a-bfd8-063996d8b530),volume_type_id=914a70e9-e46c-407a-bfd8-063996d8b530)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4af071d-a12b-4a68-967c-c6409705f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4af071d-a12b-4a68-967c-c6409705f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95484153-5116-44d6-aac6-44b63cfa9676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:11 devstack cinder-volume[87242]: DEBUG cinder.image.glance [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Creating Keystone auth plugin from conf {{(pid=87242) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:48:12 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45 1073741824" returned: 0 in 0.854s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:12 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45 Sep 25 10:48:12 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95484153-5116-44d6-aac6-44b63cfa9676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c0fe7fe-f83f-4057-8391-88555685a212', 'volume_name': 'volume-7c0fe7fe-f83f-4057-8391-88555685a212', 'volume_size': 1, 'image_id': '0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--105931933', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8280110e7a8146d892ae5f434d42273a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'created_at': datetime.datetime(2026, 9, 25, 8, 48, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 48, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ca9a346-f095-42f6-a2c9-d7c75df6c047/file', 'properties': {}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bd710c-21c8-47c1-9798-07921b6c5dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bd710c-21c8-47c1-9798-07921b6c5dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debb903a-7ab2-488a-81f5-f53adfc3d0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:12 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Volume 7c0fe7fe-f83f-4057-8391-88555685a212: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c0fe7fe-f83f-4057-8391-88555685a212', 'volume_size': 1, 'image_id': '0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--105931933', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8280110e7a8146d892ae5f434d42273a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'created_at': datetime.datetime(2026, 9, 25, 8, 48, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 48, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ca9a346-f095-42f6-a2c9-d7c75df6c047/file', 'properties': {}}, 'image_service': } Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Trying to clone 7c0fe7fe-f83f-4057-8391-88555685a212 from image 0ca9a346-f095-42f6-a2c9-d7c75df6c047 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'metadata': {}}]). {{(pid=87242) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:12 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Flow 'volume_create_manager' (851b8d18-3006-4b6b-961c-c1fd4d513a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd5e82d-9c44-4f05-a4f8-fc915e37e47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45" returned: 0 in 0.770s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd5e82d-9c44-4f05-a4f8-fc915e37e47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643736367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c639272-12a2-4735-b304-95124273c9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed6c121568942518c313b48a2896b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:13Z,use_quota=True,user_id='a43c13aa0a8b4ee9b8d9883f62f9a020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711c7f40-6ec6-4a0d-8d61-66481cb9bdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711c7f40-6ec6-4a0d-8d61-66481cb9bdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb32feb9-ab16-4854-9dd0-9fcaad736df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb32feb9-ab16-4854-9dd0-9fcaad736df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c639272-12a2-4735-b304-95124273c9db', 'volume_name': 'volume-5c639272-12a2-4735-b304-95124273c9db', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f235088f-9dda-47b4-932a-359b726ae6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f235088f-9dda-47b4-932a-359b726ae6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d144d951-635e-474f-a330-78f818ccdde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:12 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Volume 5c639272-12a2-4735-b304-95124273c9db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c639272-12a2-4735-b304-95124273c9db', 'volume_size': 1} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643736367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c639272-12a2-4735-b304-95124273c9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed6c121568942518c313b48a2896b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:13Z,use_quota=True,user_id='a43c13aa0a8b4ee9b8d9883f62f9a020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Creating volume 5c639272-12a2-4735-b304-95124273c9db {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:13 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348a864a-321f-46ed-95bf-005a3ef865d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7961798c-f0c7-457a-89e7-af53d32a4f45', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52603bdf-e09b-4f3c-b41f-3c2b19900587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:13 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Volume volume-7961798c-f0c7-457a-89e7-af53d32a4f45 (7961798c-f0c7-457a-89e7-af53d32a4f45): created successfully Sep 25 10:48:13 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db 1073741824 Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52603bdf-e09b-4f3c-b41f-3c2b19900587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:13 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Flow 'volume_create_manager' (e9da68ab-66e0-4638-ad6b-5362fb986198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:13 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c3c8b687-2505-4c92-911a-95dded2b8ab6 tempest-TestInstancesWithCinderVolumes-1944774987 None] Created volume successfully. Sep 25 10:48:13 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db 1073741824" returned: 0 in 0.932s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:14 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db Sep 25 10:48:14 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:14 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db" returned: 0 in 0.404s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:48:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d144d951-635e-474f-a330-78f818ccdde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c639272-12a2-4735-b304-95124273c9db', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c77c0f5-da5b-452e-954e-bfd54a240f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:14 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Volume volume-5c639272-12a2-4735-b304-95124273c9db (5c639272-12a2-4735-b304-95124273c9db): created successfully Sep 25 10:48:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c77c0f5-da5b-452e-954e-bfd54a240f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Flow 'volume_create_manager' (851b8d18-3006-4b6b-961c-c1fd4d513a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:14 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-de33f32e-609e-4929-95ec-f61f6e47443d tempest-ProjectReaderTests-371684202 None] Created volume successfully. Sep 25 10:48:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Acquiring lock "cinder-5c639272-12a2-4735-b304-95124273c9db-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Lock "cinder-5c639272-12a2-4735-b304-95124273c9db-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Acquiring lock "cinder-quobyte-5c639272-12a2-4735-b304-95124273c9db" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Lock "cinder-quobyte-5c639272-12a2-4735-b304-95124273c9db" acquired by "delete_volume" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:15 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f8df5-b010-420b-9c3e-79909a381d40]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:15 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db Sep 25 10:48:15 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:15 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db" returned: 0 in 0.491s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:15 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db Sep 25 10:48:15 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:16 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c639272-12a2-4735-b304-95124273c9db" returned: 0 in 0.357s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Lock "cinder-quobyte-5c639272-12a2-4735-b304-95124273c9db" released by "delete_volume" :: held 0.915s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Created reservations ['9993ab0b-914e-428b-a9d4-d5ac501454fa', 'a423d35d-4012-4cf6-9522-26b567a2938b', 'daf25336-ab11-4fec-9cdd-59202c716dd6', '2562a17d-9afd-4d8d-b562-303802ea2f54'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:16 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:48:16 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:16 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.357s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Deleted volume successfully. Sep 25 10:48:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-30d20877-cbd0-4156-8dd8-9e230d4e8adf tempest-ProjectReaderTests-371684202 None] Lock "cinder-5c639272-12a2-4735-b304-95124273c9db-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:17 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD, size 20.69 MB, duration 5.42 sec {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:48:17 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Image download 20.69 MB at 3.82 MB/s Sep 25 10:48:17 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ae5a06-8593-488a-87e7-ac63dd412f3d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:18 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD Sep 25 10:48:18 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:18 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Temporary image 0ca9a346-f095-42f6-a2c9-d7c75df6c047 is fetched for user b92a3443489e4959b7448f77808f424f. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5871b181-4ea3-43dd-b7cf-2c885eef1ad4]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:18 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD Sep 25 10:48:18 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:18 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2087148938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0fe7fe-f83f-4057-8391-88555685a212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8280110e7a8146d892ae5f434d42273a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:11Z,use_quota=True,user_id='b92a3443489e4959b7448f77808f424f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914a70e9-e46c-407a-bfd8-063996d8b530),volume_type_id=914a70e9-e46c-407a-bfd8-063996d8b530)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Creating volume 7c0fe7fe-f83f-4057-8391-88555685a212 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:18 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:48:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:19 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 1073741824 Sep 25 10:48:19 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:19 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 1073741824" returned: 0 in 0.612s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:19 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 Sep 25 10:48:19 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:19 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212" returned: 0 in 0.330s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:48:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:20 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Attempting download of 0ca9a346-f095-42f6-a2c9-d7c75df6c047 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'metadata': {}}])) to volume 7c0fe7fe-f83f-4057-8391-88555685a212. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 10:48:20 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5762ecfa-2b25-4e2e-a3c3-d895f6812985]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ca9a346-f095-42f6-a2c9-d7c75df6c047_5rim7nnz {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:20 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ca9a346-f095-42f6-a2c9-d7c75df6c047_5rim7nnz Sep 25 10:48:20 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:20 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ca9a346-f095-42f6-a2c9-d7c75df6c047_5rim7nnz" returned: 0 in 0.378s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ca9a346-f095-42f6-a2c9-d7c75df6c047_5rim7nnz {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:20 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ca9a346-f095-42f6-a2c9-d7c75df6c047_5rim7nnz Sep 25 10:48:20 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:20 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ca9a346-f095-42f6-a2c9-d7c75df6c047_5rim7nnz" returned: 1 in 0.509s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ca9a346-f095-42f6-a2c9-d7c75df6c047_5rim7nnz' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:48:21 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d41783a-28a4-4b11-bae2-c9b4c5beef38]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:21 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD Sep 25 10:48:21 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:21 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:21 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] 0ca9a346-f095-42f6-a2c9-d7c75df6c047 was qcow2, converting to qcow2 {{(pid=87242) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:48:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:21 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 Sep 25 10:48:21 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:24 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212" returned: 0 in 3.368s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:24 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ca9a346-f095-42f6-a2c9-d7c75df6c047_09ol65nqdevstack@QuobyteHD, size 112.00 MB, duration 3.37 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:48:24 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Converted 112.00 MB image at 33.24 MB/s Sep 25 10:48:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:24 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 1G Sep 25 10:48:24 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:25 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 1G" returned: 0 in 0.508s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:25 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Downloaded image 0ca9a346-f095-42f6-a2c9-d7c75df6c047 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'metadata': {}}])) to volume 7c0fe7fe-f83f-4057-8391-88555685a212 successfully. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 10:48:25 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Temporary image 0ca9a346-f095-42f6-a2c9-d7c75df6c047 for user b92a3443489e4959b7448f77808f424f is deleted. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:48:25 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Marking volume 7c0fe7fe-f83f-4057-8391-88555685a212 as bootable. {{(pid=87242) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 10:48:25 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Copying metadata from image 0ca9a346-f095-42f6-a2c9-d7c75df6c047 to 7c0fe7fe-f83f-4057-8391-88555685a212. {{(pid=87242) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:48:25 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Creating volume glance metadata for volume 7c0fe7fe-f83f-4057-8391-88555685a212 backed by image 0ca9a346-f095-42f6-a2c9-d7c75df6c047 with: {'image_id': '0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'image_name': 'tempest-scenario-img--105931933', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87242) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:48:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debb903a-7ab2-488a-81f5-f53adfc3d0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0fe7fe-f83f-4057-8391-88555685a212', 'volume_size': 1, 'image_id': '0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--105931933', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8280110e7a8146d892ae5f434d42273a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ca9a346-f095-42f6-a2c9-d7c75df6c047', 'created_at': datetime.datetime(2026, 9, 25, 8, 48, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 48, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ca9a346-f095-42f6-a2c9-d7c75df6c047/file', 'properties': {}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd71c5bc-8327-4765-9d94-ab3bb45e069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:25 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Volume volume-7c0fe7fe-f83f-4057-8391-88555685a212 (7c0fe7fe-f83f-4057-8391-88555685a212): created successfully Sep 25 10:48:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd71c5bc-8327-4765-9d94-ab3bb45e069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:25 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Flow 'volume_create_manager' (ae71c632-b4be-4114-ab53-9bbc78a501d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:25 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5c5ab594-5bf5-46f6-a9a3-7adfa3b768d4 tempest-TestInstancesWithCinderVolumes-1944774987 None] Created volume successfully. Sep 25 10:48:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-d5b827a4-f1ff-4ca9-9a74-f41c7c51cdb9 req-77a78707-5bcf-43f7-86d0-7424e2aed4ab tempest-TestStampPattern-1612230375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-d5b827a4-f1ff-4ca9-9a74-f41c7c51cdb9 req-77a78707-5bcf-43f7-86d0-7424e2aed4ab tempest-TestStampPattern-1612230375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-d5b827a4-f1ff-4ca9-9a74-f41c7c51cdb9 req-77a78707-5bcf-43f7-86d0-7424e2aed4ab tempest-TestStampPattern-1612230375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-d5b827a4-f1ff-4ca9-9a74-f41c7c51cdb9 req-77a78707-5bcf-43f7-86d0-7424e2aed4ab tempest-TestStampPattern-1612230375 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-d4647819-7573-48ef-bf92-e404f8e72a61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b18592b2-e1a7-4f4c-9042-b5a1f9e2c0c1', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:48:28 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-d5b827a4-f1ff-4ca9-9a74-f41c7c51cdb9 req-77a78707-5bcf-43f7-86d0-7424e2aed4ab tempest-TestStampPattern-1612230375 None] attachment_update completed successfully. Sep 25 10:48:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-351c4ae4-cf41-427a-9642-61ba729607d6 req-3ebd58da-1621-4493-9c24-146aa6d88d8e tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-351c4ae4-cf41-427a-9642-61ba729607d6 req-3ebd58da-1621-4493-9c24-146aa6d88d8e tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-351c4ae4-cf41-427a-9642-61ba729607d6 req-3ebd58da-1621-4493-9c24-146aa6d88d8e tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-351c4ae4-cf41-427a-9642-61ba729607d6 req-3ebd58da-1621-4493-9c24-146aa6d88d8e tempest-TestInstancesWithCinderVolumes-1944774987 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-7c0fe7fe-f83f-4057-8391-88555685a212', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '629383f0-e800-48db-b464-4078465320bf', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:48:31 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-351c4ae4-cf41-427a-9642-61ba729607d6 req-3ebd58da-1621-4493-9c24-146aa6d88d8e tempest-TestInstancesWithCinderVolumes-1944774987 None] attachment_update completed successfully. Sep 25 10:48:33 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-ef2dc1f0-9893-4122-a870-59b30258ede3 req-f33d978b-cde9-466b-940a-ab0cf31f9388 tempest-TestStampPattern-1612230375 None] Terminate volume connection completed successfully. Sep 25 10:48:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-ef2dc1f0-9893-4122-a870-59b30258ede3 req-f33d978b-cde9-466b-940a-ab0cf31f9388 tempest-TestStampPattern-1612230375 None] Deleting attachment b18592b2-e1a7-4f4c-9042-b5a1f9e2c0c1. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:48:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Acquiring lock "cinder-d4647819-7573-48ef-bf92-e404f8e72a61-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Lock "cinder-d4647819-7573-48ef-bf92-e404f8e72a61-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:43 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=61,cinder:UPDATE=55,cinder:DELETE=7,cinder:INSERT=16 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:48:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Acquiring lock "cinder-quobyte-d4647819-7573-48ef-bf92-e404f8e72a61" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-d4647819-7573-48ef-bf92-e404f8e72a61" acquired by "delete_volume" :: waited 0.039s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:43 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[14feb882-6506-4125-bb9e-883875fdc434]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:44 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 Sep 25 10:48:44 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Flow 'volume_create_manager' (53a91041-2856-426b-bc7a-38b07d52cd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0495b101-bc84-4136-8864-8fdf156ced66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0495b101-bc84-4136-8864-8fdf156ced66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-36759568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6abc94f-a496-4b7f-b66d-00bb55c01a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7abc66e2d54a5cb0071e8907f99faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:44Z,use_quota=True,user_id='bbbf6a3d8fc74a34aa19e4bc184e4188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f44670e-15f0-4fa3-adfc-994b10c5916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f44670e-15f0-4fa3-adfc-994b10c5916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f134d39-1524-4605-ae67-a0509be161a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f134d39-1524-4605-ae67-a0509be161a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6abc94f-a496-4b7f-b66d-00bb55c01a0a', 'volume_name': 'volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c154b6-feb0-4fdf-ab9b-424aee2bd699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c154b6-feb0-4fdf-ab9b-424aee2bd699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fc142d-d200-4673-9104-a36986709689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:44 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Volume b6abc94f-a496-4b7f-b66d-00bb55c01a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a', 'volume_size': 1} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-36759568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6abc94f-a496-4b7f-b66d-00bb55c01a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7abc66e2d54a5cb0071e8907f99faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:48:44Z,use_quota=True,user_id='bbbf6a3d8fc74a34aa19e4bc184e4188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Creating volume b6abc94f-a496-4b7f-b66d-00bb55c01a0a {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:48:44 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:48:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:44 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a 1073741824 Sep 25 10:48:44 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:45 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61" returned: 0 in 1.299s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:45 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61 Sep 25 10:48:45 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:45 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d4647819-7573-48ef-bf92-e404f8e72a61" returned: 0 in 0.621s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-d4647819-7573-48ef-bf92-e404f8e72a61" released by "delete_volume" :: held 2.089s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:45 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Created reservations ['8b24d7ea-0efb-41df-a8e1-e16cc79f06f3', '14da1214-f79d-48d5-b1d2-ffdeae2a8ed0', '7d0b0319-43e5-4fe0-a3d5-63873b7db24f', '204b7bbc-c642-4204-87f4-6c714a48368c'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:46 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:48:46 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:46 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a 1073741824" returned: 0 in 1.425s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:46 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a Sep 25 10:48:46 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:46 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.591s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:48:46 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Deleted volume successfully. Sep 25 10:48:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d588526-fb35-4e18-a2ab-e3ea7fc6b7bf tempest-TestStampPattern-1612230375 None] Lock "cinder-d4647819-7573-48ef-bf92-e404f8e72a61-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:47 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a" returned: 0 in 0.776s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] <== create_volume: return (2360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:48:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.373s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fc142d-d200-4673-9104-a36986709689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec20752-dbed-4f6f-af3d-adc1ee8b707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:48:47 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Volume volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a (b6abc94f-a496-4b7f-b66d-00bb55c01a0a): created successfully Sep 25 10:48:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec20752-dbed-4f6f-af3d-adc1ee8b707f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:48:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Flow 'volume_create_manager' (53a91041-2856-426b-bc7a-38b07d52cd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:48:47 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-809b7dc3-bc2d-4bdc-927f-f47b744286f9 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Created volume successfully. Sep 25 10:48:47 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Acquiring lock "cinder-7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Lock "cinder-7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Acquiring lock "cinder-quobyte-16a33efc-cb3a-4664-9a20-d60a49f0fde0" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-16a33efc-cb3a-4664-9a20-d60a49f0fde0" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Acquiring lock "cinder-quobyte-7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Deleting offline snapshot 7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 of volume 16a33efc-cb3a-4664-9a20-d60a49f0fde0 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] snapshot_file for this snap is: volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bea33b-01df-46ef-895e-b528877a7234]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:48 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 Sep 25 10:48:48 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:48 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174" returned: 0 in 0.755s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[349b05e2-8cc1-428f-baca-3f9a35336404]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:48:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:49 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 Sep 25 10:48:49 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-8b2d07ff-a357-4441-aa59-6ec4f411078d req-6a40e9ee-6b8a-4b18-8218-7942248b03a1 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:48:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-8b2d07ff-a357-4441-aa59-6ec4f411078d req-6a40e9ee-6b8a-4b18-8218-7942248b03a1 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:48:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-8b2d07ff-a357-4441-aa59-6ec4f411078d req-6a40e9ee-6b8a-4b18-8218-7942248b03a1 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:48:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-8b2d07ff-a357-4441-aa59-6ec4f411078d req-6a40e9ee-6b8a-4b18-8218-7942248b03a1 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b7ba069-1917-4fd7-a400-6c675b4399fe', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:48:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-8b2d07ff-a357-4441-aa59-6ec4f411078d req-6a40e9ee-6b8a-4b18-8218-7942248b03a1 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] attachment_update completed successfully. Sep 25 10:48:50 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0" returned: 0 in 1.365s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:50 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 Sep 25 10:48:50 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:51 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174" returned: 0 in 0.858s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:48:51 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174 Sep 25 10:48:51 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:48:52 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 25 10:48:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0.7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174" returned: 0 in 1.216s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:48:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174" released by "_delete_snapshot" :: held 4.556s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-16a33efc-cb3a-4664-9a20-d60a49f0fde0" released by "delete_snapshot" :: held 4.628s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:52 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=73,cinder:SELECT=61,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:48:52 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Created reservations ['c6a6c23e-053d-4411-93a1-c1c51ea7659b', '6a4b410f-2f3a-41b9-a95f-b144425313d7', '6d932589-cd25-4282-88ae-3551177c3143', '89976b68-a8e7-411c-b3aa-fe59c06a7c55'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:48:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Delete snapshot completed successfully. Sep 25 10:48:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5dac94b6-36c0-438b-8c26-4698469cc690 tempest-TestStampPattern-1612230375 None] Lock "cinder-7ec8a23b-3dbd-4c44-b4d8-b81b6b9f5174-delete_snapshot" released by "delete_snapshot" :: held 5.233s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:48:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-471eaafc-3249-4f64-a86e-25e25a6afe13 req-fe578a70-1a4f-4174-a4b4-fd0228f350ab tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Terminate volume connection completed successfully. Sep 25 10:48:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-471eaafc-3249-4f64-a86e-25e25a6afe13 req-fe578a70-1a4f-4174-a4b4-fd0228f350ab tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Deleting attachment 6b7ba069-1917-4fd7-a400-6c675b4399fe. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:48:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Acquiring lock "cinder-b6abc94f-a496-4b7f-b66d-00bb55c01a0a-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "cinder-b6abc94f-a496-4b7f-b66d-00bb55c01a0a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Acquiring lock "cinder-quobyte-b6abc94f-a496-4b7f-b66d-00bb55c01a0a" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "cinder-quobyte-b6abc94f-a496-4b7f-b66d-00bb55c01a0a" acquired by "delete_volume" :: waited 0.046s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:00 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f7feb2-3297-4692-b9aa-f5aa2e8504d7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:00 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a Sep 25 10:49:00 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:01 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a" returned: 0 in 1.106s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:01 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a Sep 25 10:49:01 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:01 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b6abc94f-a496-4b7f-b66d-00bb55c01a0a" returned: 0 in 0.586s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "cinder-quobyte-b6abc94f-a496-4b7f-b66d-00bb55c01a0a" released by "delete_volume" :: held 1.827s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:02 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Created reservations ['7a07e9f6-5643-428c-883e-ca10773153cc', '794c40af-2fa6-407e-bbd9-80c430da97b4', 'dd405d16-2da3-4ea8-8357-2104d73ac290', '0778153a-9208-468f-80ad-cfc8f407ffa6'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:02 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:49:02 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:03 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.882s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:03 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Deleted volume successfully. Sep 25 10:49:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5af17ead-10c2-4b36-b826-784d485071c3 tempest-TestServerVolumeAttachScenarioOldVersion-914678194 None] Lock "cinder-b6abc94f-a496-4b7f-b66d-00bb55c01a0a-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:49:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:03 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:49:03 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:04 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.709s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:49:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:49:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:49:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Acquiring lock "cinder-16a33efc-cb3a-4664-9a20-d60a49f0fde0-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Lock "cinder-16a33efc-cb3a-4664-9a20-d60a49f0fde0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Acquiring lock "cinder-quobyte-16a33efc-cb3a-4664-9a20-d60a49f0fde0" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-16a33efc-cb3a-4664-9a20-d60a49f0fde0" acquired by "delete_volume" :: waited 0.043s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:07 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb44a6-f58d-4216-af8c-989ed2cbe64c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:07 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 Sep 25 10:49:07 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:08 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0" returned: 0 in 0.665s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:08 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0 Sep 25 10:49:08 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:08 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16a33efc-cb3a-4664-9a20-d60a49f0fde0" returned: 0 in 0.635s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Lock "cinder-quobyte-16a33efc-cb3a-4664-9a20-d60a49f0fde0" released by "delete_volume" :: held 1.475s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:08 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Created reservations ['653e873b-aba5-4259-a271-dff953265eda', 'a8a4b937-bfca-479c-9b0c-9674612028a3', 'e8c1a126-89d2-4c20-972d-d24f39a4ca34', '243c721a-31fe-4911-8747-78a0f5fc084f'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:09 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:49:09 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:09 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.437s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:09 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Deleted volume successfully. Sep 25 10:49:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ed1b5f88-d677-4665-a93a-f5be18383f40 tempest-TestStampPattern-1612230375 None] Lock "cinder-16a33efc-cb3a-4664-9a20-d60a49f0fde0-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Flow 'volume_create_manager' (71dd2c0b-bffd-4340-9058-436ee4f0ab2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2180eb3a-08dc-4201-a32d-639490167e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2180eb3a-08dc-4201-a32d-639490167e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1216162427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867fd861-c57f-49af-9416-c9213bebc51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550d0456475246168c43397ce28e74bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:14Z,use_quota=True,user_id='9695fc35070b4d93989fa21f0fde9b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e880c623-53b2-4475-afef-423c28e578a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e880c623-53b2-4475-afef-423c28e578a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff2cc04-4cf7-4ab8-ac1d-00e803ce1c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff2cc04-4cf7-4ab8-ac1d-00e803ce1c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867fd861-c57f-49af-9416-c9213bebc51c', 'volume_name': 'volume-867fd861-c57f-49af-9416-c9213bebc51c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6625f6-be42-44b1-bfce-e1049192fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6625f6-be42-44b1-bfce-e1049192fa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeeb00a2-9efe-4429-888e-6ad60c97d7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:14 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Volume 867fd861-c57f-49af-9416-c9213bebc51c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867fd861-c57f-49af-9416-c9213bebc51c', 'volume_size': 1} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1216162427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867fd861-c57f-49af-9416-c9213bebc51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550d0456475246168c43397ce28e74bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:14Z,use_quota=True,user_id='9695fc35070b4d93989fa21f0fde9b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Creating volume 867fd861-c57f-49af-9416-c9213bebc51c {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:49:14 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:49:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:14 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c 1073741824 Sep 25 10:49:14 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:15 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c 1073741824" returned: 0 in 0.818s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:15 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c Sep 25 10:49:15 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:15 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c" returned: 0 in 0.377s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:49:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeeb00a2-9efe-4429-888e-6ad60c97d7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867fd861-c57f-49af-9416-c9213bebc51c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5dc2a31-2ad3-4ff1-9ce0-8e205f3e4426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:15 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Volume volume-867fd861-c57f-49af-9416-c9213bebc51c (867fd861-c57f-49af-9416-c9213bebc51c): created successfully Sep 25 10:49:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5dc2a31-2ad3-4ff1-9ce0-8e205f3e4426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:15 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Flow 'volume_create_manager' (71dd2c0b-bffd-4340-9058-436ee4f0ab2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:15 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e9c8b6d8-05c0-4e40-9f11-5a063a9167c4 tempest-SnapshotDependencyTests-1322595443 None] Created volume successfully. Sep 25 10:49:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Creating offline snapshot 34849f58-10e4-4942-8d01-7896f312c44b of volume 867fd861-c57f-49af-9416-c9213bebc51c {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:49:16 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa059129-b40d-4e65-8f76-edadd0c81a87]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:17 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c Sep 25 10:49:17 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:17 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c" returned: 0 in 0.583s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:17 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b 1G Sep 25 10:49:17 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:18 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b 1G" returned: 0 in 0.805s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-867fd861-c57f-49af-9416-c9213bebc51c -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:18 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-867fd861-c57f-49af-9416-c9213bebc51c -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b Sep 25 10:49:18 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:18 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-867fd861-c57f-49af-9416-c9213bebc51c -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b" returned: 0 in 0.582s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:18 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b is being set with open permissions: ugo+rw Sep 25 10:49:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:18 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b Sep 25 10:49:18 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:19 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b" returned: 0 in 0.416s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:19 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.info Sep 25 10:49:19 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:19 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.info" returned: 0 in 0.454s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:19 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.info is being set with open permissions: ugo+rw Sep 25 10:49:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:19 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.info Sep 25 10:49:19 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:20 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.info" returned: 0 in 0.291s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.306s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8e5e24a1-e3b7-4564-8824-7d3dde36e0f1 tempest-SnapshotDependencyTests-1322595443 None] Create snapshot completed successfully Sep 25 10:49:21 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Flow 'volume_create_manager' (cc780ec6-79d2-4b49-bfeb-6ac6ecca7b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85015215-e5a5-4b9b-9315-f048d1c284f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85015215-e5a5-4b9b-9315-f048d1c284f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c6b14e-e019-43f0-8345-55db54769040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550d0456475246168c43397ce28e74bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=34849f58-10e4-4942-8d01-7896f312c44b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:22Z,use_quota=True,user_id='9695fc35070b4d93989fa21f0fde9b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e4ed1b-6915-4153-b822-68c17c9be1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e4ed1b-6915-4153-b822-68c17c9be1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880cc90c-7155-4e22-9593-162b1621e1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880cc90c-7155-4e22-9593-162b1621e1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a3c6b14e-e019-43f0-8345-55db54769040', 'volume_name': 'volume-a3c6b14e-e019-43f0-8345-55db54769040', 'volume_size': 1, 'snapshot_id': '34849f58-10e4-4942-8d01-7896f312c44b'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1126d24-bcad-4556-ae31-d51b1b53c439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1126d24-bcad-4556-ae31-d51b1b53c439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedb8816-0ec6-45c4-856e-bf517c0f8589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:22 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Volume a3c6b14e-e019-43f0-8345-55db54769040: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a3c6b14e-e019-43f0-8345-55db54769040', 'volume_size': 1, 'snapshot_id': '34849f58-10e4-4942-8d01-7896f312c44b'} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-df6d4e41-ea17-40e3-a43d-60009f0b4111 req-13ea22c4-5477-4b17-b366-a4b8cdb0ea72 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-df6d4e41-ea17-40e3-a43d-60009f0b4111 req-13ea22c4-5477-4b17-b366-a4b8cdb0ea72 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-df6d4e41-ea17-40e3-a43d-60009f0b4111 req-13ea22c4-5477-4b17-b366-a4b8cdb0ea72 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "cinder-quobyte-34849f58-10e4-4942-8d01-7896f312c44b-a3c6b14e-e019-43f0-8345-55db54769040" by "_create_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-34849f58-10e4-4942-8d01-7896f312c44b-a3c6b14e-e019-43f0-8345-55db54769040" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Creating volume a3c6b14e-e019-43f0-8345-55db54769040 from snapshot 34849f58-10e4-4942-8d01-7896f312c44b {{(pid=87242) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "cinder-quobyte-a3c6b14e-e019-43f0-8345-55db54769040" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-a3c6b14e-e019-43f0-8345-55db54769040" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] snapshot: 34849f58-10e4-4942-8d01-7896f312c44b, volume: a3c6b14e-e019-43f0-8345-55db54769040, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-df6d4e41-ea17-40e3-a43d-60009f0b4111 req-13ea22c4-5477-4b17-b366-a4b8cdb0ea72 tempest-TestInstancesWithCinderVolumes-1944774987 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7780ac90-aa07-4811-a02f-6620d94d06f5', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6051d1-d7b0-427c-a805-7d3e83dd16aa]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-df6d4e41-ea17-40e3-a43d-60009f0b4111 req-13ea22c4-5477-4b17-b366-a4b8cdb0ea72 tempest-TestInstancesWithCinderVolumes-1944774987 None] attachment_update completed successfully. Sep 25 10:49:22 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b Sep 25 10:49:22 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:22 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b" returned: 0 in 0.609s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-867fd861-c57f-49af-9416-c9213bebc51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c05efdd-d320-442c-ad75-de5143d661b4]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:23 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c Sep 25 10:49:23 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:23 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c" returned: 0 in 0.535s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:49:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:49:23 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:49:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:23 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 Sep 25 10:49:23 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-d871e01e-b1da-4c03-b843-1eabbf467569 req-200cd474-1142-4093-afff-0410605fbff5 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:32 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=46,cinder:UPDATE=41,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:49:32 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040" returned: 0 in 9.353s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:32 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c, size 1024.00 MB, duration 9.35 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:49:32 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Converted 1024.00 MB image at 109.47 MB/s Sep 25 10:49:32 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 is being set with open permissions: ugo+rw Sep 25 10:49:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:32 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 Sep 25 10:49:32 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:33 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040" returned: 0 in 0.317s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-a3c6b14e-e019-43f0-8345-55db54769040" released by "_copy_volume_from_snapshot" :: held 11.070s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-34849f58-10e4-4942-8d01-7896f312c44b-a3c6b14e-e019-43f0-8345-55db54769040" released by "_create_volume_from_snapshot" :: held 11.207s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.228s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-d871e01e-b1da-4c03-b843-1eabbf467569 req-200cd474-1142-4093-afff-0410605fbff5 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.485s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-d871e01e-b1da-4c03-b843-1eabbf467569 req-200cd474-1142-4093-afff-0410605fbff5 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedb8816-0ec6-45c4-856e-bf517c0f8589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c6b14e-e019-43f0-8345-55db54769040', 'volume_size': 1, 'snapshot_id': '34849f58-10e4-4942-8d01-7896f312c44b'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b302cd2b-00db-498c-8532-f111597f4092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:33 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Volume volume-a3c6b14e-e019-43f0-8345-55db54769040 (a3c6b14e-e019-43f0-8345-55db54769040): created successfully Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b302cd2b-00db-498c-8532-f111597f4092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Flow 'volume_create_manager' (cc780ec6-79d2-4b49-bfeb-6ac6ecca7b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-d871e01e-b1da-4c03-b843-1eabbf467569 req-200cd474-1142-4093-afff-0410605fbff5 tempest-TestInstancesWithCinderVolumes-1944774987 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-7961798c-f0c7-457a-89e7-af53d32a4f45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d5897d5-2596-4cb6-bc89-1252bf9c774d', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:49:33 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a4434523-ad4b-4734-8430-64387eee8f97 tempest-SnapshotDependencyTests-1322595443 None] Created volume successfully. Sep 25 10:49:33 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-d871e01e-b1da-4c03-b843-1eabbf467569 req-200cd474-1142-4093-afff-0410605fbff5 tempest-TestInstancesWithCinderVolumes-1944774987 None] attachment_update completed successfully. Sep 25 10:49:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "cinder-34849f58-10e4-4942-8d01-7896f312c44b-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-34849f58-10e4-4942-8d01-7896f312c44b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "cinder-quobyte-867fd861-c57f-49af-9416-c9213bebc51c" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-867fd861-c57f-49af-9416-c9213bebc51c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "cinder-quobyte-34849f58-10e4-4942-8d01-7896f312c44b" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-34849f58-10e4-4942-8d01-7896f312c44b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Deleting offline snapshot 34849f58-10e4-4942-8d01-7896f312c44b of volume 867fd861-c57f-49af-9416-c9213bebc51c {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:49:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] snapshot_file for this snap is: volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:49:34 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[869469e0-dc64-4766-9b7e-57cfe1bf4cb6]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:34 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b Sep 25 10:49:34 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:35 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b" returned: 0 in 0.682s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-867fd861-c57f-49af-9416-c9213bebc51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b02605-07ab-431b-875c-044aeb300847]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Flow 'volume_create_manager' (9c7a163a-6cf2-4b09-a3ad-7e7cbd6db33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:35 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c Sep 25 10:49:35 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc60ed4-a551-4cda-a114-5b47f1c6fd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc60ed4-a551-4cda-a114-5b47f1c6fd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-222427735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4343d7-9570-4086-9a3d-c8ba23e91a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1237fd223fdd46eaab62556e834d8dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:36Z,use_quota=True,user_id='399e2dfa32bf4abc9c324189dd545295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3e3339-4057-4b71-b11f-7d31319105d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3e3339-4057-4b71-b11f-7d31319105d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c53258d-79e5-45ef-8b8d-68f31a994c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c53258d-79e5-45ef-8b8d-68f31a994c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4343d7-9570-4086-9a3d-c8ba23e91a50', 'volume_name': 'volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa688ce-e9dc-4005-bda2-ed95ef067560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa688ce-e9dc-4005-bda2-ed95ef067560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d558664b-5810-4e85-b8cb-e36e2eb1fb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:35 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Volume 6c4343d7-9570-4086-9a3d-c8ba23e91a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50', 'volume_size': 1} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-222427735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4343d7-9570-4086-9a3d-c8ba23e91a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1237fd223fdd46eaab62556e834d8dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:36Z,use_quota=True,user_id='399e2dfa32bf4abc9c324189dd545295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Creating volume 6c4343d7-9570-4086-9a3d-c8ba23e91a50 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:49:35 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:49:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:35 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 1073741824 Sep 25 10:49:35 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:36 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c" returned: 0 in 0.815s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:36 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b Sep 25 10:49:36 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:36 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 1073741824" returned: 0 in 0.645s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:36 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 Sep 25 10:49:36 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:36 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b" returned: 0 in 0.549s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:36 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b Sep 25 10:49:36 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:36 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50" returned: 0 in 0.426s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d558664b-5810-4e85-b8cb-e36e2eb1fb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2649ade-68d8-4490-bef5-dab03f0fcd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:36 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Volume volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 (6c4343d7-9570-4086-9a3d-c8ba23e91a50): created successfully Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2649ade-68d8-4490-bef5-dab03f0fcd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Flow 'volume_create_manager' (9c7a163a-6cf2-4b09-a3ad-7e7cbd6db33b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:36 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7c8fac95-e620-4c90-b38e-9ebb8e036a60 tempest-VolumeDependencyTests-1822653968 None] Created volume successfully. Sep 25 10:49:37 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c.34849f58-10e4-4942-8d01-7896f312c44b" returned: 0 in 0.377s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-34849f58-10e4-4942-8d01-7896f312c44b" released by "_delete_snapshot" :: held 2.602s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-867fd861-c57f-49af-9416-c9213bebc51c" released by "delete_snapshot" :: held 2.639s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:37 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Created reservations ['fd8f712b-d18d-4294-930e-ea888f77c72f', '9974e7a4-6210-4e22-ba73-fc237553e4e3', 'a23c46c5-b0e1-413e-806d-a3e9e245020d', 'b20a46db-a2de-4bc7-94a0-39a46bfda00d'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:37 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Delete snapshot completed successfully. Sep 25 10:49:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-60d28269-7f5c-4e18-bf25-3e2e5d30837a tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-34849f58-10e4-4942-8d01-7896f312c44b-delete_snapshot" released by "delete_snapshot" :: held 2.834s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "cinder-867fd861-c57f-49af-9416-c9213bebc51c-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-867fd861-c57f-49af-9416-c9213bebc51c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Creating offline snapshot 7b80e743-2986-4e79-993b-df7152f6c928 of volume 6c4343d7-9570-4086-9a3d-c8ba23e91a50 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "cinder-quobyte-867fd861-c57f-49af-9416-c9213bebc51c" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9ff6d0-7f44-454e-80b3-0dc30a221acd]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-867fd861-c57f-49af-9416-c9213bebc51c" acquired by "delete_volume" :: waited 0.036s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2df6f88-7ab3-4b7d-97d4-f97ec9ab1a3d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:38 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 Sep 25 10:49:38 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:38 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c Sep 25 10:49:38 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:38 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50" returned: 0 in 0.625s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:38 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 1G Sep 25 10:49:38 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:38 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c" returned: 0 in 0.639s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:38 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c Sep 25 10:49:38 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:39 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-867fd861-c57f-49af-9416-c9213bebc51c" returned: 0 in 0.524s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-867fd861-c57f-49af-9416-c9213bebc51c" released by "delete_volume" :: held 1.277s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Created reservations ['3062f7c7-ccc3-4480-9456-3c9debe4bb92', 'f2519c52-ff7a-429e-8700-dea03048cd47', 'e9fd7383-6c5f-4b17-8f9d-a44c3a764f99', 'edfacf09-18d7-487c-af0d-3afe2c7cd375'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:39 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 1G" returned: 0 in 0.789s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:39 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 Sep 25 10:49:39 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:39 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:49:39 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:39 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928" returned: 0 in 0.433s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:39 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 is being set with open permissions: ugo+rw Sep 25 10:49:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:40 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 Sep 25 10:49:40 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:40 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.518s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:40 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Deleted volume successfully. Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-397279c2-e857-4882-a026-3059328fe95d tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-867fd861-c57f-49af-9416-c9213bebc51c-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:40 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928" returned: 0 in 0.369s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "cinder-a3c6b14e-e019-43f0-8345-55db54769040-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-a3c6b14e-e019-43f0-8345-55db54769040-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:40 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.info Sep 25 10:49:40 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "cinder-quobyte-a3c6b14e-e019-43f0-8345-55db54769040" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-a3c6b14e-e019-43f0-8345-55db54769040" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9894aab2-570d-4380-9f98-f1f785f15fe7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:40 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 Sep 25 10:49:40 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:40 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.info" returned: 0 in 0.491s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:40 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.info is being set with open permissions: ugo+rw Sep 25 10:49:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:40 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.info Sep 25 10:49:41 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:41 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040" returned: 0 in 0.659s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:41 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040 Sep 25 10:49:41 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:41 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.info" returned: 0 in 0.421s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.316s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-90ea9954-9e6c-4c8a-8ecb-00f6f966379e tempest-VolumeDependencyTests-1822653968 None] Create snapshot completed successfully Sep 25 10:49:41 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3c6b14e-e019-43f0-8345-55db54769040" returned: 0 in 0.406s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-quobyte-a3c6b14e-e019-43f0-8345-55db54769040" released by "delete_volume" :: held 1.131s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-ccd0162c-3b77-49c0-9175-44baef33b424 req-43434691-e950-4b8b-8020-00e84e2ef814 tempest-TestInstancesWithCinderVolumes-1944774987 None] Terminate volume connection completed successfully. Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-ccd0162c-3b77-49c0-9175-44baef33b424 req-43434691-e950-4b8b-8020-00e84e2ef814 tempest-TestInstancesWithCinderVolumes-1944774987 None] Deleting attachment 7780ac90-aa07-4811-a02f-6620d94d06f5. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Created reservations ['ad5d06a4-b372-4f3f-8a62-da054dadce92', '7d971ada-6ca2-4228-b1f9-2f99698b4a18', '209cd78b-4d25-4448-b720-10936540df04', '5a179553-682a-413c-8352-6176008e05cf'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:41 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:49:41 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "cinder-8f6780cb-5d70-43b7-87ad-6e46a6d7f903-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-8f6780cb-5d70-43b7-87ad-6e46a6d7f903-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "cinder-quobyte-8f6780cb-5d70-43b7-87ad-6e46a6d7f903" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-quobyte-8f6780cb-5d70-43b7-87ad-6e46a6d7f903" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:42 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dbc958-808e-4f34-8847-93b51f471b16]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:42 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.440s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:42 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:42 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Deleted volume successfully. Sep 25 10:49:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8d9e5bd8-e58a-4b1e-bb0b-7bd15346c631 tempest-SnapshotDependencyTests-1322595443 None] Lock "cinder-a3c6b14e-e019-43f0-8345-55db54769040-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:42 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903 Sep 25 10:49:42 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:43 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903" returned: 0 in 0.840s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:43 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903 Sep 25 10:49:43 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:43 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-8f6780cb-5d70-43b7-87ad-6e46a6d7f903" returned: 0 in 0.556s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-quobyte-8f6780cb-5d70-43b7-87ad-6e46a6d7f903" released by "delete_volume" :: held 1.493s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:43 devstack cinder-volume[87242]: WARNING cinder.quota [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754577126-129677273 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754577126-129677273, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:49:43 devstack cinder-volume[87242]: WARNING cinder.quota [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754577126-129677273 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1754577126-129677273, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Flow 'volume_create_manager' (df654a2d-464d-49fb-8261-afdf90b3e0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b74274-6adb-4b93-b6d8-06da86f1070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b74274-6adb-4b93-b6d8-06da86f1070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-973205599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7012d1dd-5bba-4803-a2c2-c7015402fa94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1237fd223fdd46eaab62556e834d8dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7b80e743-2986-4e79-993b-df7152f6c928,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:49:44Z,use_quota=True,user_id='399e2dfa32bf4abc9c324189dd545295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e476eee-1f65-4eee-b6ad-510d4e302c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e476eee-1f65-4eee-b6ad-510d4e302c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c068c7d2-4685-44b0-84c4-9ce24ce4f80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c068c7d2-4685-44b0-84c4-9ce24ce4f80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7012d1dd-5bba-4803-a2c2-c7015402fa94', 'volume_name': 'volume-7012d1dd-5bba-4803-a2c2-c7015402fa94', 'volume_size': 1, 'snapshot_id': '7b80e743-2986-4e79-993b-df7152f6c928'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3081f190-5c21-4cc9-82fb-5dec4f8e4f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3081f190-5c21-4cc9-82fb-5dec4f8e4f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb18600-65cb-4cd6-978c-1a02bba0e2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:44 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Volume 7012d1dd-5bba-4803-a2c2-c7015402fa94: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7012d1dd-5bba-4803-a2c2-c7015402fa94', 'volume_size': 1, 'snapshot_id': '7b80e743-2986-4e79-993b-df7152f6c928'} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Created reservations ['137720a1-7ab1-4d23-acb4-259c4d46262e', 'a4e8f407-d11b-4bec-b987-a328576eca20', '83cf51b0-679c-42f0-b650-d815a7d20557', '6545139d-f972-4d77-9ce0-aebc950c2967'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "cinder-quobyte-7b80e743-2986-4e79-993b-df7152f6c928-7012d1dd-5bba-4803-a2c2-c7015402fa94" by "_create_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-7b80e743-2986-4e79-993b-df7152f6c928-7012d1dd-5bba-4803-a2c2-c7015402fa94" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Creating volume 7012d1dd-5bba-4803-a2c2-c7015402fa94 from snapshot 7b80e743-2986-4e79-993b-df7152f6c928 {{(pid=87242) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "cinder-quobyte-7012d1dd-5bba-4803-a2c2-c7015402fa94" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-7012d1dd-5bba-4803-a2c2-c7015402fa94" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] snapshot: 7b80e743-2986-4e79-993b-df7152f6c928, volume: 7012d1dd-5bba-4803-a2c2-c7015402fa94, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4059be-3721-4e7a-b450-9a0a434f0534]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:44 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:49:44 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:44 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 Sep 25 10:49:44 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:44 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.572s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Deleted volume successfully. Sep 25 10:49:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d17d2cb4-f08e-427a-8948-f58641213701 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-8f6780cb-5d70-43b7-87ad-6e46a6d7f903-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:45 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928" returned: 0 in 0.825s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:45 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7dd0d3-3c24-42dc-8f10-139b18ab4a0c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:45 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 Sep 25 10:49:45 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:45 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50" returned: 0 in 0.528s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:49:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:49:45 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:49:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:45 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 Sep 25 10:49:45 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:49 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-95179608-9590-4dc4-bcbe-7bc111237f78 req-a2b04557-2f33-4f33-a37d-5e34a3b3a1e0 tempest-TestInstancesWithCinderVolumes-1944774987 None] Terminate volume connection completed successfully. Sep 25 10:49:49 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-95179608-9590-4dc4-bcbe-7bc111237f78 req-a2b04557-2f33-4f33-a37d-5e34a3b3a1e0 tempest-TestInstancesWithCinderVolumes-1944774987 None] Deleting attachment 5d5897d5-2596-4cb6-bc89-1252bf9c774d. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:49:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "cinder-7961798c-f0c7-457a-89e7-af53d32a4f45-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-7961798c-f0c7-457a-89e7-af53d32a4f45-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "cinder-quobyte-7961798c-f0c7-457a-89e7-af53d32a4f45" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-quobyte-7961798c-f0c7-457a-89e7-af53d32a4f45" acquired by "delete_volume" :: waited 0.095s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:51 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a407dd-8af0-48e0-8c97-acd828b007ed]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:51 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45 Sep 25 10:49:51 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:52 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45" returned: 0 in 1.146s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:52 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45 Sep 25 10:49:52 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:53 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7961798c-f0c7-457a-89e7-af53d32a4f45" returned: 0 in 0.909s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-quobyte-7961798c-f0c7-457a-89e7-af53d32a4f45" released by "delete_volume" :: held 2.194s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:53 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=72,cinder:INSERT=20,cinder:UPDATE=66,cinder:DELETE=6 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:49:53 devstack cinder-volume[87242]: WARNING cinder.quota [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-103198096-1598064929 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-103198096-1598064929, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:49:53 devstack cinder-volume[87242]: WARNING cinder.quota [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-103198096-1598064929 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-103198096-1598064929, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:49:53 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Created reservations ['136c9daa-3f58-4f25-b5c3-19a522272ae9', 'cc564124-c66f-47a2-b2b3-67b36b3f4ae0', 'c9ae5cc1-822b-42c9-8c1a-87f3861dc26c', '19897a08-6747-49a2-9dcf-38b402f32432'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:49:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:49:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:49:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:49:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:49:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:53 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:49:53 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:54 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.712s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:54 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:49:54 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Deleted volume successfully. Sep 25 10:49:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-72f4a62a-7081-4c1a-a89a-3033638f330d tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-7961798c-f0c7-457a-89e7-af53d32a4f45-delete_volume" released by "delete_volume" :: held 3.908s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:57 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94" returned: 0 in 11.870s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:57 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50, size 1024.00 MB, duration 11.87 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:49:57 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Converted 1024.00 MB image at 86.26 MB/s Sep 25 10:49:57 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 is being set with open permissions: ugo+rw Sep 25 10:49:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:57 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 Sep 25 10:49:57 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:57 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94" returned: 0 in 0.318s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-7012d1dd-5bba-4803-a2c2-c7015402fa94" released by "_copy_volume_from_snapshot" :: held 13.717s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-7b80e743-2986-4e79-993b-df7152f6c928-7012d1dd-5bba-4803-a2c2-c7015402fa94" released by "_create_volume_from_snapshot" :: held 13.842s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:49:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.882s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:49:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb18600-65cb-4cd6-978c-1a02bba0e2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7012d1dd-5bba-4803-a2c2-c7015402fa94', 'volume_size': 1, 'snapshot_id': '7b80e743-2986-4e79-993b-df7152f6c928'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae377809-f792-428e-8086-b07f712e7b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:49:57 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Volume volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 (7012d1dd-5bba-4803-a2c2-c7015402fa94): created successfully Sep 25 10:49:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae377809-f792-428e-8086-b07f712e7b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:49:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Flow 'volume_create_manager' (df654a2d-464d-49fb-8261-afdf90b3e0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:49:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-9fe03752-e7eb-41f0-83f5-b53f41c3d54f tempest-VolumeDependencyTests-1822653968 None] Created volume successfully. Sep 25 10:49:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "cinder-7b80e743-2986-4e79-993b-df7152f6c928-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-7b80e743-2986-4e79-993b-df7152f6c928-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "cinder-quobyte-6c4343d7-9570-4086-9a3d-c8ba23e91a50" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-6c4343d7-9570-4086-9a3d-c8ba23e91a50" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "cinder-quobyte-7b80e743-2986-4e79-993b-df7152f6c928" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-7b80e743-2986-4e79-993b-df7152f6c928" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Deleting offline snapshot 7b80e743-2986-4e79-993b-df7152f6c928 of volume 6c4343d7-9570-4086-9a3d-c8ba23e91a50 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] snapshot_file for this snap is: volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[292c6167-d1e5-4722-839f-5c37f44ebdcc]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:59 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 Sep 25 10:49:59 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:49:59 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928" returned: 0 in 0.516s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e34e77-32ac-40bb-9764-60a869d63011]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:49:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:49:59 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 Sep 25 10:49:59 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:00 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50" returned: 0 in 0.846s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:00 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 Sep 25 10:50:00 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:01 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928" returned: 0 in 0.500s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:01 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928 Sep 25 10:50:01 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:01 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50.7b80e743-2986-4e79-993b-df7152f6c928" returned: 0 in 0.318s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-7b80e743-2986-4e79-993b-df7152f6c928" released by "_delete_snapshot" :: held 2.365s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-6c4343d7-9570-4086-9a3d-c8ba23e91a50" released by "delete_snapshot" :: held 2.397s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:01 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Created reservations ['dd88012a-4407-4dc8-88fb-26d267b6a942', '3d7fa06f-82c3-476a-9556-62d499e90a34', '4681f85a-1051-4624-b6d1-ffb23703121c', 'd3de2878-5190-417e-91e3-73048f95f27e'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:01 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Delete snapshot completed successfully. Sep 25 10:50:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ae24cdd1-2a26-4837-8ff8-35ebe041fea2 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-7b80e743-2986-4e79-993b-df7152f6c928-delete_snapshot" released by "delete_snapshot" :: held 2.612s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "cinder-6c4343d7-9570-4086-9a3d-c8ba23e91a50-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-6c4343d7-9570-4086-9a3d-c8ba23e91a50-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "cinder-quobyte-6c4343d7-9570-4086-9a3d-c8ba23e91a50" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-6c4343d7-9570-4086-9a3d-c8ba23e91a50" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:02 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[41752c8f-7062-46ef-9c32-0bcc89930e64]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:02 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 Sep 25 10:50:02 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:03 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50" returned: 0 in 0.548s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:03 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50 Sep 25 10:50:03 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:03 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:03 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:50:03 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-6c4343d7-9570-4086-9a3d-c8ba23e91a50" returned: 0 in 0.447s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-6c4343d7-9570-4086-9a3d-c8ba23e91a50" released by "delete_volume" :: held 1.141s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Created reservations ['23d367d8-7926-450b-9b78-ca8c9e018b28', '0b4910f8-732f-4932-9c15-d4799c71b71f', 'b7473c7b-0acc-4875-a641-c098131a90d8', '9a8424c0-e30a-40da-ad3c-9e22f08194ab'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:04 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:50:04 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:04 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.677s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:50:04 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.481s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Deleted volume successfully. Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-686c3ff6-1992-4384-a8ce-928a99e9f015 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-6c4343d7-9570-4086-9a3d-c8ba23e91a50-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "cinder-7012d1dd-5bba-4803-a2c2-c7015402fa94-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-7012d1dd-5bba-4803-a2c2-c7015402fa94-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "cinder-quobyte-7012d1dd-5bba-4803-a2c2-c7015402fa94" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-7012d1dd-5bba-4803-a2c2-c7015402fa94" acquired by "delete_volume" :: waited 0.066s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4429e36-9c28-437a-9842-c63f7a75f88a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:05 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 Sep 25 10:50:05 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:05 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94" returned: 0 in 0.967s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:06 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94 Sep 25 10:50:06 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:06 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7012d1dd-5bba-4803-a2c2-c7015402fa94" returned: 0 in 0.450s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-quobyte-7012d1dd-5bba-4803-a2c2-c7015402fa94" released by "delete_volume" :: held 1.522s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:06 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Created reservations ['3d3d19fd-76c9-4e72-bb6a-e9c595a6dfee', '3a294441-f09b-4318-a8a9-c765d5a5ac39', '7a4cbcc5-a39e-4aef-a314-a42ff014fecc', '7ace7087-6fc0-489b-8eb7-ad4f120b49a5'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:06 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:50:06 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:07 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.348s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:07 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Deleted volume successfully. Sep 25 10:50:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ec5b5c86-18af-4200-8039-0a7c063b35b0 tempest-VolumeDependencyTests-1822653968 None] Lock "cinder-7012d1dd-5bba-4803-a2c2-c7015402fa94-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:08 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-f0af61f8-179c-4e4a-9b1e-02ec6fdb45e9 req-8c6e22bd-4c6e-4d2d-894e-8037f16b72d7 tempest-TestInstancesWithCinderVolumes-1944774987 None] Terminate volume connection completed successfully. Sep 25 10:50:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-f0af61f8-179c-4e4a-9b1e-02ec6fdb45e9 req-8c6e22bd-4c6e-4d2d-894e-8037f16b72d7 tempest-TestInstancesWithCinderVolumes-1944774987 None] Deleting attachment 629383f0-e800-48db-b464-4078465320bf. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:50:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "cinder-7c0fe7fe-f83f-4057-8391-88555685a212-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-7c0fe7fe-f83f-4057-8391-88555685a212-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "cinder-quobyte-7c0fe7fe-f83f-4057-8391-88555685a212" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-quobyte-7c0fe7fe-f83f-4057-8391-88555685a212" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:09 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2820db2-1640-47e3-89f9-13ddc6be9e06]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:10 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 Sep 25 10:50:10 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:10 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212" returned: 0 in 0.671s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:10 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212 Sep 25 10:50:10 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:10 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-7c0fe7fe-f83f-4057-8391-88555685a212" returned: 0 in 0.430s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-quobyte-7c0fe7fe-f83f-4057-8391-88555685a212" released by "delete_volume" :: held 1.213s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:11 devstack cinder-volume[87242]: WARNING cinder.quota [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1409527008-794546781 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1409527008-794546781, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:50:11 devstack cinder-volume[87242]: WARNING cinder.quota [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1409527008-794546781 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1409527008-794546781, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:50:11 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Created reservations ['8c5e289e-4261-432a-b830-db2634bcfd7c', '481912e5-d59d-41b0-a725-8c27de92af7c', '260f34dc-bba4-4990-9172-e87e5be0db55', '5608bf44-1760-4f8c-83da-6bb811a34177'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:11 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:50:11 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:11 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.361s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:11 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Deleted volume successfully. Sep 25 10:50:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-0a988313-dc27-4819-8707-3b38ffe15392 tempest-TestInstancesWithCinderVolumes-1944774987 None] Lock "cinder-7c0fe7fe-f83f-4057-8391-88555685a212-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:16 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Flow 'volume_create_manager' (95bff8d9-cf5a-4f6c-bc33-aea250da901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3dda959-f0ad-4ac8-8d2f-342722c88851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3dda959-f0ad-4ac8-8d2f-342722c88851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debe3a6a-9161-4475-987d-905d4074d7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bc91e423764571bb0f9fad76ca13f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:16Z,use_quota=True,user_id='3fc6f897290f43279439c619aa67495d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f280f1-0d0f-4172-a499-203181672472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f280f1-0d0f-4172-a499-203181672472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:16 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7312c06e-1aca-4ea0-9248-9edc012035cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:16 devstack cinder-volume[87242]: DEBUG cinder.image.glance [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Creating Keystone auth plugin from conf {{(pid=87242) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:50:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7312c06e-1aca-4ea0-9248-9edc012035cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'debe3a6a-9161-4475-987d-905d4074d7e7', 'volume_name': 'volume-debe3a6a-9161-4475-987d-905d4074d7e7', 'volume_size': 1, 'image_id': '40e2d20c-8baf-4462-906f-2eb02c7bf328', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40e2d20c-8baf-4462-906f-2eb02c7bf328', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7e357b1f48c0983703e0ea51ade9b2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a1bc91e423764571bb0f9fad76ca13f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '47db515d7c2f6ef23a68d1eba9cc10b54c712370d9abed7480f45fec5de0c1d4e316c48d0c5a6900e8d304c075f0cb5145e420b28ef8603e54ad84806233f425', 'id': '40e2d20c-8baf-4462-906f-2eb02c7bf328', 'created_at': datetime.datetime(2026, 9, 25, 8, 50, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 50, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40e2d20c-8baf-4462-906f-2eb02c7bf328/file', 'properties': {}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae2a16f-0f06-4b89-bdbc-bb9b0586cf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae2a16f-0f06-4b89-bdbc-bb9b0586cf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bc0ad1-63a5-4787-9026-4e6fbef30819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:17 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Volume debe3a6a-9161-4475-987d-905d4074d7e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-debe3a6a-9161-4475-987d-905d4074d7e7', 'volume_size': 1, 'image_id': '40e2d20c-8baf-4462-906f-2eb02c7bf328', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40e2d20c-8baf-4462-906f-2eb02c7bf328', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7e357b1f48c0983703e0ea51ade9b2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a1bc91e423764571bb0f9fad76ca13f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '47db515d7c2f6ef23a68d1eba9cc10b54c712370d9abed7480f45fec5de0c1d4e316c48d0c5a6900e8d304c075f0cb5145e420b28ef8603e54ad84806233f425', 'id': '40e2d20c-8baf-4462-906f-2eb02c7bf328', 'created_at': datetime.datetime(2026, 9, 25, 8, 50, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 50, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40e2d20c-8baf-4462-906f-2eb02c7bf328/file', 'properties': {}}, 'image_service': } Sep 25 10:50:17 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Trying to clone debe3a6a-9161-4475-987d-905d4074d7e7 from image 40e2d20c-8baf-4462-906f-2eb02c7bf328 at location (None, [{'url': 'file:///opt/stack/data/glance/images/40e2d20c-8baf-4462-906f-2eb02c7bf328', 'metadata': {}}]). {{(pid=87242) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:50:17 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:50:17 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Image download 0.00 MB at 0.00 MB/s Sep 25 10:50:17 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a98bd4-ec98-429c-ba5b-f321e2abb7c1]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:17 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD Sep 25 10:50:17 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:17 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:18 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD Sep 25 10:50:18 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:18 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD" returned: 1 in 0.489s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:50:18 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Temporary image 40e2d20c-8baf-4462-906f-2eb02c7bf328 is fetched for user 3fc6f897290f43279439c619aa67495d. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:50:18 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec140885-e51f-4117-a4f3-193cb2ce5f25]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:18 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD Sep 25 10:50:18 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:19 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD" returned: 0 in 0.544s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:19 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD Sep 25 10:50:19 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:19 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD" returned: 1 in 0.496s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debe3a6a-9161-4475-987d-905d4074d7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bc91e423764571bb0f9fad76ca13f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:16Z,use_quota=True,user_id='3fc6f897290f43279439c619aa67495d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Creating volume debe3a6a-9161-4475-987d-905d4074d7e7 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:19 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:50:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:19 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 1073741824 Sep 25 10:50:19 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:20 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 1073741824" returned: 0 in 0.810s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:20 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 Sep 25 10:50:20 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:20 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7" returned: 0 in 0.414s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:50:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:20 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Attempting download of 40e2d20c-8baf-4462-906f-2eb02c7bf328 ((None, [{'url': 'file:///opt/stack/data/glance/images/40e2d20c-8baf-4462-906f-2eb02c7bf328', 'metadata': {}}])) to volume debe3a6a-9161-4475-987d-905d4074d7e7. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 10:50:20 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45a0864-d2ad-463c-b159-79a7313d0f52]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40e2d20c-8baf-4462-906f-2eb02c7bf328_n9q8xhue {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:21 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40e2d20c-8baf-4462-906f-2eb02c7bf328_n9q8xhue Sep 25 10:50:21 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:21 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40e2d20c-8baf-4462-906f-2eb02c7bf328_n9q8xhue" returned: 0 in 0.531s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40e2d20c-8baf-4462-906f-2eb02c7bf328_n9q8xhue {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:21 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40e2d20c-8baf-4462-906f-2eb02c7bf328_n9q8xhue Sep 25 10:50:21 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:21 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40e2d20c-8baf-4462-906f-2eb02c7bf328_n9q8xhue" returned: 1 in 0.421s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40e2d20c-8baf-4462-906f-2eb02c7bf328_n9q8xhue' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:50:21 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19f86e5-600b-47e2-9305-7c6d45e2e524]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:22 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD Sep 25 10:50:22 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:22 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:22 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD Sep 25 10:50:22 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:22 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD" returned: 1 in 0.507s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:50:22 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] 40e2d20c-8baf-4462-906f-2eb02c7bf328 was raw, converting to qcow2 {{(pid=87242) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:50:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:23 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 Sep 25 10:50:23 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:23 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7" returned: 0 in 0.808s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:23 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_40e2d20c-8baf-4462-906f-2eb02c7bf328_leyltb9gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:50:23 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 10:50:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:23 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 1G Sep 25 10:50:23 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:24 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 1G" returned: 0 in 0.569s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:24 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Downloaded image 40e2d20c-8baf-4462-906f-2eb02c7bf328 ((None, [{'url': 'file:///opt/stack/data/glance/images/40e2d20c-8baf-4462-906f-2eb02c7bf328', 'metadata': {}}])) to volume debe3a6a-9161-4475-987d-905d4074d7e7 successfully. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 10:50:24 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Temporary image 40e2d20c-8baf-4462-906f-2eb02c7bf328 for user 3fc6f897290f43279439c619aa67495d is deleted. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:50:24 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Marking volume debe3a6a-9161-4475-987d-905d4074d7e7 as bootable. {{(pid=87242) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 10:50:24 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Copying metadata from image 40e2d20c-8baf-4462-906f-2eb02c7bf328 to debe3a6a-9161-4475-987d-905d4074d7e7. {{(pid=87242) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:50:24 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Creating volume glance metadata for volume debe3a6a-9161-4475-987d-905d4074d7e7 backed by image 40e2d20c-8baf-4462-906f-2eb02c7bf328 with: {'image_id': '40e2d20c-8baf-4462-906f-2eb02c7bf328', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a7e357b1f48c0983703e0ea51ade9b2e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87242) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:50:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bc0ad1-63a5-4787-9026-4e6fbef30819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-debe3a6a-9161-4475-987d-905d4074d7e7', 'volume_size': 1, 'image_id': '40e2d20c-8baf-4462-906f-2eb02c7bf328', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40e2d20c-8baf-4462-906f-2eb02c7bf328', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7e357b1f48c0983703e0ea51ade9b2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a1bc91e423764571bb0f9fad76ca13f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '47db515d7c2f6ef23a68d1eba9cc10b54c712370d9abed7480f45fec5de0c1d4e316c48d0c5a6900e8d304c075f0cb5145e420b28ef8603e54ad84806233f425', 'id': '40e2d20c-8baf-4462-906f-2eb02c7bf328', 'created_at': datetime.datetime(2026, 9, 25, 8, 50, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 50, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40e2d20c-8baf-4462-906f-2eb02c7bf328/file', 'properties': {}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618935dc-aea1-440b-91a1-299bc5ba541e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:24 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Volume volume-debe3a6a-9161-4475-987d-905d4074d7e7 (debe3a6a-9161-4475-987d-905d4074d7e7): created successfully Sep 25 10:50:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618935dc-aea1-440b-91a1-299bc5ba541e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:24 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Flow 'volume_create_manager' (95bff8d9-cf5a-4f6c-bc33-aea250da901a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:24 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-9469db19-77a7-4c4a-98bb-7d4dcbcc64d0 tempest-VolumeImageDependencyTests-1346090267 None] Created volume successfully. Sep 25 10:50:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Acquiring lock "cinder-debe3a6a-9161-4475-987d-905d4074d7e7-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Lock "cinder-debe3a6a-9161-4475-987d-905d4074d7e7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Acquiring lock "cinder-quobyte-debe3a6a-9161-4475-987d-905d4074d7e7" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:50:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Lock "cinder-quobyte-debe3a6a-9161-4475-987d-905d4074d7e7" acquired by "delete_volume" :: waited 0.044s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:50:25 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[097a84e1-d98c-429d-993f-9cd78cd3a81e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:25 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 Sep 25 10:50:25 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:26 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7" returned: 0 in 0.554s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:26 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7 Sep 25 10:50:26 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:26 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-debe3a6a-9161-4475-987d-905d4074d7e7" returned: 0 in 0.317s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Lock "cinder-quobyte-debe3a6a-9161-4475-987d-905d4074d7e7" released by "delete_volume" :: held 0.955s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:26 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Created reservations ['292af66a-7898-442b-8889-dc780cb5a2c5', 'a929fa97-84a8-4fb2-94fc-cd3b67f50fb9', '7dee1c13-5630-4d3b-9e9a-9351f1fdbbd7', 'e57fb6a6-07d0-471e-8b08-73e1ef47729f'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:50:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:27 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:50:27 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:27 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.299s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:27 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:50:27 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Deleted volume successfully. Sep 25 10:50:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-229e5118-7752-4c82-9715-1f31acb42462 tempest-VolumeImageDependencyTests-1346090267 None] Lock "cinder-debe3a6a-9161-4475-987d-905d4074d7e7-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:50:27 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Flow 'volume_create_manager' (348a3169-9ff4-4c1a-a064-62ac3074cd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9382498d-3d0c-4e02-8ccb-a0156d90dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9382498d-3d0c-4e02-8ccb-a0156d90dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1929499818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badd3dc7-c899-4ce2-9be4-1998fc12d453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb937f4d84344ea941c74a84a846a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:28Z,use_quota=True,user_id='03f8cda1ce5448f48675de0b70853e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c994ce9-18ca-4123-bcba-9e968d621e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c994ce9-18ca-4123-bcba-9e968d621e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddfeaeb-c444-408b-a7f7-8e0a8e2fff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.image.glance [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Creating Keystone auth plugin from conf {{(pid=87242) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddfeaeb-c444-408b-a7f7-8e0a8e2fff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'badd3dc7-c899-4ce2-9be4-1998fc12d453', 'volume_name': 'volume-badd3dc7-c899-4ce2-9be4-1998fc12d453', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0d926c-7fd4-46cd-8b01-c294e089b4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0d926c-7fd4-46cd-8b01-c294e089b4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f108c7d-33b6-4f5d-920f-31df74229e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:28 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Volume badd3dc7-c899-4ce2-9be4-1998fc12d453: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-badd3dc7-c899-4ce2-9be4-1998fc12d453', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 10:50:28 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Trying to clone badd3dc7-c899-4ce2-9be4-1998fc12d453 from image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]). {{(pid=87242) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:50:29 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:50:29 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Image download 20.69 MB at 20.69 MB/s Sep 25 10:50:29 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b96d58-df9e-4982-b621-4f107f5e27c8]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:29 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD Sep 25 10:50:29 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:30 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD" returned: 0 in 0.528s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Temporary image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c is fetched for user 03f8cda1ce5448f48675de0b70853e1f. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31ab585-e4c2-43e6-95a4-b9ffe175dc4c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:30 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD Sep 25 10:50:30 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:30 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1929499818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badd3dc7-c899-4ce2-9be4-1998fc12d453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb937f4d84344ea941c74a84a846a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:50:28Z,use_quota=True,user_id='03f8cda1ce5448f48675de0b70853e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Creating volume badd3dc7-c899-4ce2-9be4-1998fc12d453 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:50:30 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:50:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:30 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 1073741824 Sep 25 10:50:30 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:31 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 1073741824" returned: 0 in 0.664s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:31 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 Sep 25 10:50:31 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:31 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453" returned: 0 in 0.324s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:50:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:31 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Attempting download of 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c ((None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}])) to volume badd3dc7-c899-4ce2-9be4-1998fc12d453. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 10:50:31 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2d2295-b288-444a-bf62-117d96ad4dfd]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_977h6a6n {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:31 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_977h6a6n Sep 25 10:50:31 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:32 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_977h6a6n" returned: 0 in 0.501s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_977h6a6n {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:32 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_977h6a6n Sep 25 10:50:32 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:32 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_977h6a6n" returned: 1 in 0.433s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_977h6a6n' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:50:32 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eec762c-362c-451b-9368-8aff35db1311]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:50:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:32 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD Sep 25 10:50:32 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:33 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD" returned: 0 in 0.518s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:33 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c was qcow2, converting to qcow2 {{(pid=87242) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:50:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:33 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 Sep 25 10:50:33 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:35 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:INSERT=31,cinder:UPDATE=93,cinder:SELECT=82,cinder:DELETE=5 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:50:36 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453" returned: 0 in 3.027s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:36 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c_n67fgpy0devstack@QuobyteHD, size 112.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:50:36 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Converted 112.00 MB image at 36.98 MB/s Sep 25 10:50:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:50:36 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 1G Sep 25 10:50:36 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:50:36 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 25 10:50:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 1G" returned: 0 in 0.668s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:50:36 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Downloaded image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c ((None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}])) to volume badd3dc7-c899-4ce2-9be4-1998fc12d453 successfully. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 10:50:36 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Temporary image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c for user 03f8cda1ce5448f48675de0b70853e1f is deleted. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:50:36 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Marking volume badd3dc7-c899-4ce2-9be4-1998fc12d453 as bootable. {{(pid=87242) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 10:50:36 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Copying metadata from image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c to badd3dc7-c899-4ce2-9be4-1998fc12d453. {{(pid=87242) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:50:36 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Creating volume glance metadata for volume badd3dc7-c899-4ce2-9be4-1998fc12d453 backed by image 3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87242) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:50:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f108c7d-33b6-4f5d-920f-31df74229e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-badd3dc7-c899-4ce2-9be4-1998fc12d453', 'volume_size': 1, 'image_id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89bd94d725a84e619416204872f19a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c', 'created_at': datetime.datetime(2026, 9, 25, 8, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c3274ac-df3e-42f9-a1fb-e5c41abe6a6c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6eb4fad-53f9-4ba1-bea2-b35405d4c601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:50:37 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Volume volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 (badd3dc7-c899-4ce2-9be4-1998fc12d453): created successfully Sep 25 10:50:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6eb4fad-53f9-4ba1-bea2-b35405d4c601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:50:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Flow 'volume_create_manager' (348a3169-9ff4-4c1a-a064-62ac3074cd6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:50:37 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e258510f-cf2c-461a-9099-72facda0f151 tempest-TestShelveInstance-1951803190 None] Created volume successfully. Sep 25 10:50:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-1922bbaf-3e8c-4fb7-b579-a42cb201d2d6 req-76ad5636-174d-419d-a4ab-f397fba8ec9c tempest-TestShelveInstance-1951803190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:50:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-1922bbaf-3e8c-4fb7-b579-a42cb201d2d6 req-76ad5636-174d-419d-a4ab-f397fba8ec9c tempest-TestShelveInstance-1951803190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:50:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-1922bbaf-3e8c-4fb7-b579-a42cb201d2d6 req-76ad5636-174d-419d-a4ab-f397fba8ec9c tempest-TestShelveInstance-1951803190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:50:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-1922bbaf-3e8c-4fb7-b579-a42cb201d2d6 req-76ad5636-174d-419d-a4ab-f397fba8ec9c tempest-TestShelveInstance-1951803190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-badd3dc7-c899-4ce2-9be4-1998fc12d453', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '790dbf13-77db-4d35-b1b5-269020d49499', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:50:42 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-1922bbaf-3e8c-4fb7-b579-a42cb201d2d6 req-76ad5636-174d-419d-a4ab-f397fba8ec9c tempest-TestShelveInstance-1951803190 None] attachment_update completed successfully. Sep 25 10:50:52 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=62,cinder:SELECT=49,cinder:DELETE=6,cinder:INSERT=20 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:50:52 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=2 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:51:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:51:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:03 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:51:03 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:04 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.498s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:51:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:51:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:51:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:51:08 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Flow 'volume_create_manager' (5e4c6db9-ac75-44ee-93ac-825e62a23b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae41992c-458e-4526-b70c-a15589c65e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae41992c-458e-4526-b70c-a15589c65e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-848434529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d47a67-2808-4bad-8d54-9e68a56a3dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6737be807b4f5f8e82481d1cb40621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:09Z,use_quota=True,user_id='a66d90b3ae974831b76264653536d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a32239-c4b4-4358-80b1-b071184dbc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a32239-c4b4-4358-80b1-b071184dbc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402b26f6-b80c-41e7-b7dd-e0d4055605bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402b26f6-b80c-41e7-b7dd-e0d4055605bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d47a67-2808-4bad-8d54-9e68a56a3dc2', 'volume_name': 'volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392ff95d-9068-4154-b54e-89e22ee5de17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392ff95d-9068-4154-b54e-89e22ee5de17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491fc729-7333-44ba-a7af-76eeba62fc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Volume 50d47a67-2808-4bad-8d54-9e68a56a3dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2', 'volume_size': 1} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-848434529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d47a67-2808-4bad-8d54-9e68a56a3dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6737be807b4f5f8e82481d1cb40621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:09Z,use_quota=True,user_id='a66d90b3ae974831b76264653536d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Creating volume 50d47a67-2808-4bad-8d54-9e68a56a3dc2 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:09 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:09 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2 1073741824 Sep 25 10:51:09 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Flow 'volume_create_manager' (2127c4c7-674b-4daa-8afd-6ef6f86694f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d12e58a-e863-48fb-9402-56d0a66eb4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d12e58a-e863-48fb-9402-56d0a66eb4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1714934233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73607b7-24f5-4635-99eb-7b7cf5a3cc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6737be807b4f5f8e82481d1cb40621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:10Z,use_quota=True,user_id='a66d90b3ae974831b76264653536d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2621638a-7007-422b-a4b3-10b25d849f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2621638a-7007-422b-a4b3-10b25d849f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44eae8f3-cc40-45ae-ab74-3db51a566b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44eae8f3-cc40-45ae-ab74-3db51a566b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73607b7-24f5-4635-99eb-7b7cf5a3cc4d', 'volume_name': 'volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd32346-ecae-4479-a5b2-d1f0cd3e9127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd32346-ecae-4479-a5b2-d1f0cd3e9127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5564fd-db2b-4552-9184-f03ec8041cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:09 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Volume e73607b7-24f5-4635-99eb-7b7cf5a3cc4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d', 'volume_size': 1} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:09 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2 1073741824" returned: 0 in 0.763s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:09 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2 Sep 25 10:51:09 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:10 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2" returned: 0 in 0.501s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1714934233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73607b7-24f5-4635-99eb-7b7cf5a3cc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6737be807b4f5f8e82481d1cb40621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:51:10Z,use_quota=True,user_id='a66d90b3ae974831b76264653536d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Creating volume e73607b7-24f5-4635-99eb-7b7cf5a3cc4d {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:51:10 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491fc729-7333-44ba-a7af-76eeba62fc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e01652-41e7-4147-9f9c-fa252af7084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:10 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d 1073741824 Sep 25 10:51:10 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:10 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Volume volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2 (50d47a67-2808-4bad-8d54-9e68a56a3dc2): created successfully Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e01652-41e7-4147-9f9c-fa252af7084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Flow 'volume_create_manager' (5e4c6db9-ac75-44ee-93ac-825e62a23b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:10 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-42503f1e-3094-4713-8b60-6b524353519f tempest-TestServerVolumeAttachmentScenario-1014066905 None] Created volume successfully. Sep 25 10:51:11 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d 1073741824" returned: 0 in 0.842s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:51:11 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d Sep 25 10:51:11 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:51:11 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Sep 25 10:51:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d" returned: 0 in 0.345s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:51:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:51:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5564fd-db2b-4552-9184-f03ec8041cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478fb6b6-c4cd-48f9-984d-77df983f11f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:51:11 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Volume volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d (e73607b7-24f5-4635-99eb-7b7cf5a3cc4d): created successfully Sep 25 10:51:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478fb6b6-c4cd-48f9-984d-77df983f11f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:51:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Flow 'volume_create_manager' (2127c4c7-674b-4daa-8afd-6ef6f86694f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:51:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8a2c812f-c6db-4263-a7d3-c38657276e01 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Created volume successfully. Sep 25 10:51:21 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=9,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:51:21 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:51:40 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-5a558054-940a-4ca1-9379-ddbd467df8df req-23cdeb4e-1365-4501-b1e0-d0e601886936 tempest-TestShelveInstance-1951803190 None] Terminate volume connection completed successfully. Sep 25 10:51:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-5a558054-940a-4ca1-9379-ddbd467df8df req-23cdeb4e-1365-4501-b1e0-d0e601886936 tempest-TestShelveInstance-1951803190 None] Deleting attachment 790dbf13-77db-4d35-b1b5-269020d49499. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:51:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-e7b2338c-beb3-40e4-a4bc-bb13329dc37e req-cbac8b46-f017-4026-bd71-118e9cbffce2 tempest-TestShelveInstance-1951803190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-e7b2338c-beb3-40e4-a4bc-bb13329dc37e req-cbac8b46-f017-4026-bd71-118e9cbffce2 tempest-TestShelveInstance-1951803190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-e7b2338c-beb3-40e4-a4bc-bb13329dc37e req-cbac8b46-f017-4026-bd71-118e9cbffce2 tempest-TestShelveInstance-1951803190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-e7b2338c-beb3-40e4-a4bc-bb13329dc37e req-cbac8b46-f017-4026-bd71-118e9cbffce2 tempest-TestShelveInstance-1951803190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-badd3dc7-c899-4ce2-9be4-1998fc12d453', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fec1d68-adae-4120-ace8-fedf71d122c2', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:51:43 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-e7b2338c-beb3-40e4-a4bc-bb13329dc37e req-cbac8b46-f017-4026-bd71-118e9cbffce2 tempest-TestShelveInstance-1951803190 None] attachment_update completed successfully. Sep 25 10:51:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-9d06ce90-c186-4b77-9427-30a3b469bdbd req-462851df-8fe9-48fd-b349-c7f55b361d3d tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-9d06ce90-c186-4b77-9427-30a3b469bdbd req-462851df-8fe9-48fd-b349-c7f55b361d3d tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-9d06ce90-c186-4b77-9427-30a3b469bdbd req-462851df-8fe9-48fd-b349-c7f55b361d3d tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-9d06ce90-c186-4b77-9427-30a3b469bdbd req-462851df-8fe9-48fd-b349-c7f55b361d3d tempest-TestServerVolumeAttachmentScenario-1014066905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35bc85f7-f6ec-4666-a145-a5baf68d3a22', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:51:48 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-9d06ce90-c186-4b77-9427-30a3b469bdbd req-462851df-8fe9-48fd-b349-c7f55b361d3d tempest-TestServerVolumeAttachmentScenario-1014066905 None] attachment_update completed successfully. Sep 25 10:51:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-065b1fd9-19d6-4b89-a217-3b79f6a9cb48 req-2ee25359-abac-46b2-bac1-484e36ac7508 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:51:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-065b1fd9-19d6-4b89-a217-3b79f6a9cb48 req-2ee25359-abac-46b2-bac1-484e36ac7508 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:51:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-065b1fd9-19d6-4b89-a217-3b79f6a9cb48 req-2ee25359-abac-46b2-bac1-484e36ac7508 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:51:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-065b1fd9-19d6-4b89-a217-3b79f6a9cb48 req-2ee25359-abac-46b2-bac1-484e36ac7508 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5', 'name': 'volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0d09956-9d9c-45e0-93af-64d5d8c1d121', 'enforce_multipath': True} {{(pid=87242) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 10:51:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-065b1fd9-19d6-4b89-a217-3b79f6a9cb48 req-2ee25359-abac-46b2-bac1-484e36ac7508 tempest-TestServerVolumeAttachmentScenario-1014066905 None] attachment_update completed successfully. Sep 25 10:51:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-b0416871-8e9e-4e83-9be3-1b21900f7c33 req-b8a34904-e64d-44d8-b2f6-44a4c1e87bab tempest-TestServerVolumeAttachmentScenario-1014066905 None] Terminate volume connection completed successfully. Sep 25 10:51:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-b0416871-8e9e-4e83-9be3-1b21900f7c33 req-b8a34904-e64d-44d8-b2f6-44a4c1e87bab tempest-TestServerVolumeAttachmentScenario-1014066905 None] Deleting attachment f0d09956-9d9c-45e0-93af-64d5d8c1d121. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:51:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-08ebf984-b381-423b-a9ff-eb91ba424fa7 req-94086e2f-46ac-453a-aa7c-a670fd015e98 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Terminate volume connection completed successfully. Sep 25 10:51:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-08ebf984-b381-423b-a9ff-eb91ba424fa7 req-94086e2f-46ac-453a-aa7c-a670fd015e98 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Deleting attachment 35bc85f7-f6ec-4666-a145-a5baf68d3a22. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:52:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "cinder-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "cinder-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "cinder-quobyte-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "cinder-quobyte-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8b5dc1-935f-4fcc-9aff-632d6a623004]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:03 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d Sep 25 10:52:03 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:03 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d" returned: 0 in 0.449s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:03 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:52:03 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:03 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d Sep 25 10:52:03 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:03 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.337s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:03 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d" returned: 0 in 0.321s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "cinder-quobyte-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d" released by "delete_volume" :: held 0.839s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:03 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Created reservations ['d2d84f62-9c16-4ae8-b1f5-9c7ebe5ddff8', 'ffdb83cd-4e0e-42b3-b527-76927387d31c', '9d3610c9-0b25-4a1c-a229-2849ba46bb91', '7ce8d827-1243-4ee0-9fc1-712e7d39da44'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:04 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:52:04 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "cinder-50d47a67-2808-4bad-8d54-9e68a56a3dc2-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "cinder-50d47a67-2808-4bad-8d54-9e68a56a3dc2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "cinder-quobyte-50d47a67-2808-4bad-8d54-9e68a56a3dc2" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "cinder-quobyte-50d47a67-2808-4bad-8d54-9e68a56a3dc2" acquired by "delete_volume" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a0121-494c-417b-bc74-78e121f803f1]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:04 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.373s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Deleted volume successfully. Sep 25 10:52:04 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2 Sep 25 10:52:04 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-51410544-f3bc-4efa-a93f-974eb4455439 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "cinder-e73607b7-24f5-4635-99eb-7b7cf5a3cc4d-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:04 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2" returned: 0 in 0.486s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:04 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2 Sep 25 10:52:04 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:05 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-50d47a67-2808-4bad-8d54-9e68a56a3dc2" returned: 0 in 0.299s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "cinder-quobyte-50d47a67-2808-4bad-8d54-9e68a56a3dc2" released by "delete_volume" :: held 0.844s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Created reservations ['96410c3a-b3fe-4af2-92bc-c3d945def731', '5848a79b-3b91-43b9-bcd7-80cc49775944', '71c4adef-3f3e-4635-89de-c1d21654d852', '61c893c4-fed1-45ec-bc4b-4f955b7cb1cb'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:05 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:52:05 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:05 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.371s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:05 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Deleted volume successfully. Sep 25 10:52:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-323637d8-c69d-4923-b527-ed7d5f652662 tempest-TestServerVolumeAttachmentScenario-1014066905 None] Lock "cinder-50d47a67-2808-4bad-8d54-9e68a56a3dc2-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:15 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=32,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:52:15 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=33,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (612edbf9-4bd1-4d1c-bc3c-ae705a2ad791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b952a55-19d3-4f49-89f9-f0409c80044a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b952a55-19d3-4f49-89f9-f0409c80044a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1582344434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ba3422-0eb6-4afa-8908-e20e0080b8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:20Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed727adc-06a1-4ed6-933c-84bfb84f7364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed727adc-06a1-4ed6-933c-84bfb84f7364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad8313c-c50b-4a31-b606-0c5a40cfe818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad8313c-c50b-4a31-b606-0c5a40cfe818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ba3422-0eb6-4afa-8908-e20e0080b8b0', 'volume_name': 'volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded4c95c-5bfc-46df-a929-a94f3f9ea94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded4c95c-5bfc-46df-a929-a94f3f9ea94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c8617e-4e61-4730-bc26-8d7971803252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:20 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume b8ba3422-0eb6-4afa-8908-e20e0080b8b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0', 'volume_size': 1} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1582344434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ba3422-0eb6-4afa-8908-e20e0080b8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:20Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Creating volume b8ba3422-0eb6-4afa-8908-e20e0080b8b0 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:20 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:20 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 1073741824 Sep 25 10:52:20 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:20 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 1073741824" returned: 0 in 0.504s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:21 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 Sep 25 10:52:21 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:21 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" returned: 0 in 0.258s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:52:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c8617e-4e61-4730-bc26-8d7971803252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65718618-c429-4d3c-9f3a-3e9645c4fddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:21 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 (b8ba3422-0eb6-4afa-8908-e20e0080b8b0): created successfully Sep 25 10:52:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65718618-c429-4d3c-9f3a-3e9645c4fddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:21 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (612edbf9-4bd1-4d1c-bc3c-ae705a2ad791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3799a15a-96fe-4884-abbb-5ec3fefd620d tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created volume successfully. Sep 25 10:52:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Creating offline snapshot 5e976322-0930-4819-8f12-a2abc03043e2 of volume b8ba3422-0eb6-4afa-8908-e20e0080b8b0 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:52:22 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2e8502-2028-4430-b61b-2a2793f5e72a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:22 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 Sep 25 10:52:22 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:23 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" returned: 0 in 0.422s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:23 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 1G Sep 25 10:52:23 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:23 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 1G" returned: 0 in 0.491s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:23 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 Sep 25 10:52:23 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:23 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2" returned: 0 in 0.336s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:23 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 is being set with open permissions: ugo+rw Sep 25 10:52:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:23 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 Sep 25 10:52:24 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:24 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2" returned: 0 in 0.268s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:24 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.info Sep 25 10:52:24 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:24 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.info" returned: 0 in 0.295s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:24 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.info is being set with open permissions: ugo+rw Sep 25 10:52:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:24 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.info Sep 25 10:52:24 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:24 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.info" returned: 0 in 0.295s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:24 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8df9423e-8c3e-4b01-9b08-159c3e45d540 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Create snapshot completed successfully Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (1196c227-512e-468d-b4a6-00d7e928fcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4171ce72-2b3a-418e-8183-da442c29a60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4171ce72-2b3a-418e-8183-da442c29a60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1625122127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde814e5-c110-49ad-97e2-f95979421115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:26Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e487cf2-98b4-4636-b874-0b50819ea174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e487cf2-98b4-4636-b874-0b50819ea174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad930b32-7343-4641-bf82-8e38a8d0acbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad930b32-7343-4641-bf82-8e38a8d0acbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde814e5-c110-49ad-97e2-f95979421115', 'volume_name': 'volume-dde814e5-c110-49ad-97e2-f95979421115', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802a71b2-3837-48fe-91fe-fb2aa97e432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802a71b2-3837-48fe-91fe-fb2aa97e432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9ae17a-9e11-43de-948f-b123cad6b259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:26 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume dde814e5-c110-49ad-97e2-f95979421115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde814e5-c110-49ad-97e2-f95979421115', 'volume_size': 1} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1625122127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde814e5-c110-49ad-97e2-f95979421115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:26Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Creating volume dde814e5-c110-49ad-97e2-f95979421115 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:26 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:26 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115 1073741824 Sep 25 10:52:26 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:26 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (144e6096-bbab-4c91-b2fa-731f11d771bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5495731-5d39-4e14-85cf-c878ca436a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5495731-5d39-4e14-85cf-c878ca436a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-981928582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4e6014-a9dd-453a-aa43-1af3ba8d5f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:27Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc232f5-b81d-4bd1-9ffa-34018abf96d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc232f5-b81d-4bd1-9ffa-34018abf96d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdb612f-5d29-4a9b-bdcd-24e97b9a7076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdb612f-5d29-4a9b-bdcd-24e97b9a7076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4e6014-a9dd-453a-aa43-1af3ba8d5f72', 'volume_name': 'volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885728aa-7736-43d4-89a2-60521c92e962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885728aa-7736-43d4-89a2-60521c92e962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6220b7-886c-4dc6-9c36-3cb2d83210a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume ec4e6014-a9dd-453a-aa43-1af3ba8d5f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72', 'volume_size': 1} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:27 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115 1073741824" returned: 0 in 0.686s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:27 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115 Sep 25 10:52:27 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (97f60915-3976-45b4-8918-46d0d2a05612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf34e06-d0fb-4421-99d3-4dc13a4f7ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf34e06-d0fb-4421-99d3-4dc13a4f7ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193661557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ee4a03-fdc6-4840-97dc-b963092f915e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:28Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc37f30-06d4-4891-aa64-35ab0739e8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc37f30-06d4-4891-aa64-35ab0739e8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1758b8-d495-4e3b-a5b8-072747623284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1758b8-d495-4e3b-a5b8-072747623284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ee4a03-fdc6-4840-97dc-b963092f915e', 'volume_name': 'volume-17ee4a03-fdc6-4840-97dc-b963092f915e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81c1389-e2b1-4096-b21e-4140cb0f5a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81c1389-e2b1-4096-b21e-4140cb0f5a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:27 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb35ff0-aa07-4029-bd23-9d372c838250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume 17ee4a03-fdc6-4840-97dc-b963092f915e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ee4a03-fdc6-4840-97dc-b963092f915e', 'volume_size': 1} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115" returned: 0 in 0.473s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-981928582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4e6014-a9dd-453a-aa43-1af3ba8d5f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:27Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Creating volume ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:27 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:27 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 1073741824 Sep 25 10:52:27 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9ae17a-9e11-43de-948f-b123cad6b259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde814e5-c110-49ad-97e2-f95979421115', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41b868f-a74d-474a-9f44-35717ffcaf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:27 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume volume-dde814e5-c110-49ad-97e2-f95979421115 (dde814e5-c110-49ad-97e2-f95979421115): created successfully Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41b868f-a74d-474a-9f44-35717ffcaf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (1196c227-512e-468d-b4a6-00d7e928fcd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:27 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6f01a214-eb70-4c41-8333-34a9e721c58b tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created volume successfully. Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (282e3533-70ca-43a5-953f-647cd1180d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f747ac27-0394-427b-bd4e-14378a0c1fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f747ac27-0394-427b-bd4e-14378a0c1fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800469327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7dc652-6838-4ac5-ba46-1c009267fe67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:28Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34ab92a-bb1d-4b69-9062-4fdcd192d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34ab92a-bb1d-4b69-9062-4fdcd192d946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d4b8c0-90cc-4deb-becd-4be076b06056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d4b8c0-90cc-4deb-becd-4be076b06056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc7dc652-6838-4ac5-ba46-1c009267fe67', 'volume_name': 'volume-cc7dc652-6838-4ac5-ba46-1c009267fe67', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f772dc32-ebd2-42e6-aa00-252364c66b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f772dc32-ebd2-42e6-aa00-252364c66b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149f2404-5b06-40b3-9aec-1b2b99114f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:28 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume cc7dc652-6838-4ac5-ba46-1c009267fe67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc7dc652-6838-4ac5-ba46-1c009267fe67', 'volume_size': 1} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:28 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 1073741824" returned: 0 in 0.907s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:28 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 Sep 25 10:52:28 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:28 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (4ca9a3bc-7b5a-422d-ad09-5fc924ce8f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48006c3-1ae4-48d2-ba74-5c90fbb5ab3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48006c3-1ae4-48d2-ba74-5c90fbb5ab3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-160465802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217fbc59-bd72-4c0f-b59d-5083c83c46ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:29Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddccebf-f1dc-4232-bc16-a649cc8ebfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddccebf-f1dc-4232-bc16-a649cc8ebfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f27745-f0c3-4ae7-a2b2-fe9f142e74be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f27745-f0c3-4ae7-a2b2-fe9f142e74be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '217fbc59-bd72-4c0f-b59d-5083c83c46ca', 'volume_name': 'volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bdf317-c615-4cde-bc66-1f6e7d0d61d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bdf317-c615-4cde-bc66-1f6e7d0d61d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff0f1ab-d45b-4e61-9d1a-74fbf8d39ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:29 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume 217fbc59-bd72-4c0f-b59d-5083c83c46ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca', 'volume_size': 1} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:29 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72" returned: 0 in 0.356s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.385s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193661557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ee4a03-fdc6-4840-97dc-b963092f915e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:28Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Creating volume 17ee4a03-fdc6-4840-97dc-b963092f915e {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:29 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6220b7-886c-4dc6-9c36-3cb2d83210a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d674933-42c8-475d-ae04-08ebcc63a74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:29 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e 1073741824 Sep 25 10:52:29 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:29 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 (ec4e6014-a9dd-453a-aa43-1af3ba8d5f72): created successfully Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d674933-42c8-475d-ae04-08ebcc63a74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:29 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (144e6096-bbab-4c91-b2fa-731f11d771bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:29 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-de1626bd-3a87-43ec-bdf5-50d6182dcba5 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created volume successfully. Sep 25 10:52:30 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e 1073741824" returned: 0 in 0.822s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:30 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e Sep 25 10:52:30 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:30 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e" returned: 0 in 0.357s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.978s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800469327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7dc652-6838-4ac5-ba46-1c009267fe67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:28Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Creating volume cc7dc652-6838-4ac5-ba46-1c009267fe67 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:30 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb35ff0-aa07-4029-bd23-9d372c838250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ee4a03-fdc6-4840-97dc-b963092f915e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047359a0-9484-4512-83fc-4b79929e6c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:30 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67 1073741824 Sep 25 10:52:30 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:30 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume volume-17ee4a03-fdc6-4840-97dc-b963092f915e (17ee4a03-fdc6-4840-97dc-b963092f915e): created successfully Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047359a0-9484-4512-83fc-4b79929e6c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (97f60915-3976-45b4-8918-46d0d2a05612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e2e02bac-32a9-473e-b26f-5b567d283fda tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created volume successfully. Sep 25 10:52:31 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67 1073741824" returned: 0 in 0.766s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:31 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67 Sep 25 10:52:31 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:31 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67" returned: 0 in 0.288s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.485s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-160465802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217fbc59-bd72-4c0f-b59d-5083c83c46ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3210146c27478d9ffe8a33437a0896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:29Z,use_quota=True,user_id='8b4f38962d9c46a4b566b565a7a6363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Creating volume 217fbc59-bd72-4c0f-b59d-5083c83c46ca {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:31 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149f2404-5b06-40b3-9aec-1b2b99114f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc7dc652-6838-4ac5-ba46-1c009267fe67', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:31 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca 1073741824 Sep 25 10:52:31 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff247db-7f63-4145-8117-a0fa405ab918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:31 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume volume-cc7dc652-6838-4ac5-ba46-1c009267fe67 (cc7dc652-6838-4ac5-ba46-1c009267fe67): created successfully Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff247db-7f63-4145-8117-a0fa405ab918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (282e3533-70ca-43a5-953f-647cd1180d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:31 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b8189f4a-8921-4cd2-95a1-1f94e44bbb45 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created volume successfully. Sep 25 10:52:32 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca 1073741824" returned: 0 in 0.726s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:32 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca Sep 25 10:52:32 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:32 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-637a3119-6099-4c49-9cab-74b904d8a422 tempest-TestShelveInstance-1951803190 None] Terminate volume connection completed successfully. Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-637a3119-6099-4c49-9cab-74b904d8a422 tempest-TestShelveInstance-1951803190 None] Deleting attachment 0fec1d68-adae-4120-ace8-fedf71d122c2. {{(pid=87242) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Acquiring lock "cinder-badd3dc7-c899-4ce2-9be4-1998fc12d453-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Lock "cinder-badd3dc7-c899-4ce2-9be4-1998fc12d453-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Acquiring lock "cinder-quobyte-badd3dc7-c899-4ce2-9be4-1998fc12d453" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:32 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Lock "cinder-quobyte-badd3dc7-c899-4ce2-9be4-1998fc12d453" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca" returned: 0 in 0.401s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d15277a-677c-4e8e-b715-c060601bb838]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff0f1ab-d45b-4e61-9d1a-74fbf8d39ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb688fa-46a8-4452-a79c-df986442b8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:32 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Volume volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca (217fbc59-bd72-4c0f-b59d-5083c83c46ca): created successfully Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb688fa-46a8-4452-a79c-df986442b8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Flow 'volume_create_manager' (4ca9a3bc-7b5a-422d-ad09-5fc924ce8f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:32 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-52b36c76-4e86-4049-8179-8adcea31e6c3 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created volume successfully. Sep 25 10:52:32 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 Sep 25 10:52:32 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:33 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453" returned: 0 in 0.513s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:33 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453 Sep 25 10:52:33 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:33 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-badd3dc7-c899-4ce2-9be4-1998fc12d453" returned: 0 in 0.326s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-217fbc59-bd72-4c0f-b59d-5083c83c46ca-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Lock "cinder-quobyte-badd3dc7-c899-4ce2-9be4-1998fc12d453" released by "delete_volume" :: held 0.919s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-217fbc59-bd72-4c0f-b59d-5083c83c46ca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-quobyte-217fbc59-bd72-4c0f-b59d-5083c83c46ca" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-217fbc59-bd72-4c0f-b59d-5083c83c46ca" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG cinder.quota [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Created reservations ['cfbe8446-7dad-43f9-b547-2c3832b56c0f', '49699ae1-fd11-40e1-9f44-0df184582bd0', '1ba0c9fb-b098-455a-9724-d5084ddcaa07', 'd8d70da2-5f38-4213-a0c9-36154bdfbd4e'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de1614c-499d-4a8b-8c66-d1f7968a99e7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:34 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca Sep 25 10:52:34 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:34 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:52:34 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:34 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.354s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:34 devstack cinder-volume[87242]: DEBUG cinder.manager [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:34 devstack cinder-volume[87242]: INFO cinder.volume.manager [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Deleted volume successfully. Sep 25 10:52:34 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca" returned: 0 in 0.484s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [req-1321ee19-86a6-46f9-adf8-07653f9bf102 req-269f8e80-b6a9-4456-b3a8-70e3edf96972 tempest-TestShelveInstance-1951803190 None] Lock "cinder-badd3dc7-c899-4ce2-9be4-1998fc12d453-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:34 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca Sep 25 10:52:34 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:34 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-217fbc59-bd72-4c0f-b59d-5083c83c46ca" returned: 0 in 0.408s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-217fbc59-bd72-4c0f-b59d-5083c83c46ca" released by "delete_volume" :: held 0.977s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:34 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created reservations ['b0ce345c-7953-4e50-966a-3ae395085325', '257989e6-d906-4c16-a43a-c8a7e061180a', 'ffee8226-c6cd-436a-9e91-6349a5e1fa9e', 'acd7096f-b415-4a5c-9f72-67705c11b96a'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:35 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:52:35 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:35 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.318s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:35 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Deleted volume successfully. Sep 25 10:52:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8167ed81-0aa8-454b-a14f-88ddcc819470 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-217fbc59-bd72-4c0f-b59d-5083c83c46ca-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-cc7dc652-6838-4ac5-ba46-1c009267fe67-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-cc7dc652-6838-4ac5-ba46-1c009267fe67-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-quobyte-cc7dc652-6838-4ac5-ba46-1c009267fe67" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-cc7dc652-6838-4ac5-ba46-1c009267fe67" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:36 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710c461-32cd-497a-b672-0cb699c60312]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:36 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67 Sep 25 10:52:36 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:36 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67" returned: 0 in 0.457s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:36 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67 Sep 25 10:52:36 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:37 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-cc7dc652-6838-4ac5-ba46-1c009267fe67" returned: 0 in 0.338s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-cc7dc652-6838-4ac5-ba46-1c009267fe67" released by "delete_volume" :: held 0.890s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created reservations ['7d85c171-152c-4321-a076-916cc0663a49', '7c362ac7-c205-4592-9016-b4c7da3f4722', '5deb4d79-2021-4e2d-b01d-ad4c7b309747', '9e36c998-6f3f-4a10-9b2f-7038669166d4'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:37 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:52:37 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-17ee4a03-fdc6-4840-97dc-b963092f915e-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-17ee4a03-fdc6-4840-97dc-b963092f915e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-quobyte-17ee4a03-fdc6-4840-97dc-b963092f915e" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-17ee4a03-fdc6-4840-97dc-b963092f915e" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0745e6c-e257-4fe0-992f-983301a883bd]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:37 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.325s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:37 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Deleted volume successfully. Sep 25 10:52:37 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e Sep 25 10:52:37 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3b069f00-e807-4332-89eb-b2db286e32a6 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-cc7dc652-6838-4ac5-ba46-1c009267fe67-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:37 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e" returned: 0 in 0.406s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:37 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e Sep 25 10:52:37 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:38 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-17ee4a03-fdc6-4840-97dc-b963092f915e" returned: 0 in 0.262s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-17ee4a03-fdc6-4840-97dc-b963092f915e" released by "delete_volume" :: held 0.723s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created reservations ['07a12634-51c8-4944-9c6f-139db2fcd496', 'f6dd6510-1792-4162-ae9e-c160f5fa7306', '6880e7ef-71c1-41ac-83bc-93f1397f29f3', '71019644-9609-4522-8358-a59831c88f4d'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:38 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:52:38 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-quobyte-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72" acquired by "delete_volume" :: waited 0.043s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:38 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.407s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:38 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Deleted volume successfully. Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecc9895-40bc-4c1c-8b84-a349ed13ec19]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4d32543a-b625-4289-ad12-798634f746aa tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-17ee4a03-fdc6-4840-97dc-b963092f915e-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:38 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 Sep 25 10:52:38 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:39 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72" returned: 0 in 0.418s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:39 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72 Sep 25 10:52:39 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:39 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72" returned: 0 in 0.298s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72" released by "delete_volume" :: held 0.785s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created reservations ['d356d8f5-e59e-4c3b-85a8-431caa714b7e', '5e34b726-9a87-437e-8d12-0194f9a0db93', 'd616966c-9e23-40dc-b4f2-6097bab8394b', '4b3e29c0-5adc-4fee-a64f-d8f30aad285e'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:39 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:52:39 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-dde814e5-c110-49ad-97e2-f95979421115-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-dde814e5-c110-49ad-97e2-f95979421115-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-quobyte-dde814e5-c110-49ad-97e2-f95979421115" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-dde814e5-c110-49ad-97e2-f95979421115" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a94264-8b15-41e1-b0ff-aa4d82c62ef0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:40 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.414s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:40 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Deleted volume successfully. Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-06795b97-560e-47cc-86be-065719715dae tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-ec4e6014-a9dd-453a-aa43-1af3ba8d5f72-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:40 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115 Sep 25 10:52:40 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:40 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115" returned: 0 in 0.446s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:40 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115 Sep 25 10:52:40 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:40 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dde814e5-c110-49ad-97e2-f95979421115" returned: 0 in 0.300s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-dde814e5-c110-49ad-97e2-f95979421115" released by "delete_volume" :: held 0.797s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created reservations ['13f96179-0ebf-46f0-8892-e00fb1ccb4e5', '9b6c514f-14af-490e-84a0-d5e19524a0f5', '7cdcf1cb-8946-4962-a508-c6b35cdf1169', '2aeeedc1-9220-4e55-ba1f-077efd25c8ee'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:41 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:52:41 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-5e976322-0930-4819-8f12-a2abc03043e2-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-5e976322-0930-4819-8f12-a2abc03043e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-quobyte-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-quobyte-5e976322-0930-4819-8f12-a2abc03043e2" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-5e976322-0930-4819-8f12-a2abc03043e2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Deleting offline snapshot 5e976322-0930-4819-8f12-a2abc03043e2 of volume b8ba3422-0eb6-4afa-8908-e20e0080b8b0 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] snapshot_file for this snap is: volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[de29ac3e-81f9-4532-b635-e438856c2dbf]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:41 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.331s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Deleted volume successfully. Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6f1ecb06-b5c8-48f9-95f1-0ce7b46ceb11 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-dde814e5-c110-49ad-97e2-f95979421115-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:41 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 Sep 25 10:52:41 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:41 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2" returned: 0 in 0.426s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d0032-0879-49c9-977e-1f78534647eb]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:41 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 Sep 25 10:52:41 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:42 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" returned: 0 in 0.471s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:42 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 Sep 25 10:52:42 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:42 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2" returned: 0 in 0.378s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:42 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2 Sep 25 10:52:42 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:42 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0.5e976322-0930-4819-8f12-a2abc03043e2" returned: 0 in 0.308s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-5e976322-0930-4819-8f12-a2abc03043e2" released by "_delete_snapshot" :: held 1.758s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" released by "delete_snapshot" :: held 1.791s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:43 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created reservations ['3ea75c3f-312c-4867-ab70-f7f034ceef77', '01d47109-9d7b-4059-b2c8-d3484d77c7c5', '7c3b01ef-60a0-4072-bc8f-4bfa59ebce5e', '3f69145e-2fba-4400-91dc-34daee6d0fc2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:43 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Delete snapshot completed successfully. Sep 25 10:52:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-6512b6a3-71e1-4e85-bdf5-7b4d08e88dc8 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-5e976322-0930-4819-8f12-a2abc03043e2-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-b8ba3422-0eb6-4afa-8908-e20e0080b8b0-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-b8ba3422-0eb6-4afa-8908-e20e0080b8b0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "cinder-quobyte-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:52:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" acquired by "delete_volume" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:52:43 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40ec0dc-b66b-4e33-b5af-3809b57079f4]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:43 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 Sep 25 10:52:43 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:43 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" returned: 0 in 0.440s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:43 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0 Sep 25 10:52:43 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:44 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" returned: 0 in 0.307s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-quobyte-b8ba3422-0eb6-4afa-8908-e20e0080b8b0" released by "delete_volume" :: held 0.856s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Created reservations ['4d2df6b8-a430-45bf-acb2-351395192b7b', 'd9b40735-69ff-4c8b-a6f2-ecaf940eeb35', '9ef979ab-d73c-4eee-8c76-8fbfac3ca5b2', '5838fb76-1463-4f74-8c1e-083e633c75f4'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:44 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:52:44 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:44 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.276s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:52:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Deleted volume successfully. Sep 25 10:52:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-de29102f-14a1-49f4-80ed-717e2ddacb86 tempest-CreateVolumesFromSnapshotTest-2097256153 None] Lock "cinder-b8ba3422-0eb6-4afa-8908-e20e0080b8b0-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:52:54 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=52,cinder:UPDATE=87,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:52:54 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=63,cinder:UPDATE=76,cinder:DELETE=8,cinder:INSERT=19 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:52:54 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:52:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Flow 'volume_create_manager' (0024121a-3cd1-4571-a0a4-6303da3e7206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:52:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d948fc2b-af76-479f-bc4c-42cc9c32ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d948fc2b-af76-479f-bc4c-42cc9c32ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42cf01c-76d2-4674-88c7-9a5aab5fec01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154e268e92b46c69b7f470bae9a6b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:55Z,use_quota=True,user_id='87b73768a8ba48d3a367d940a1d1f447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f13a518d-505e-4f22-aaac-10926a6bc064),volume_type_id=f13a518d-505e-4f22-aaac-10926a6bc064)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17fa3ea-c490-4d79-a439-4708ed168c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17fa3ea-c490-4d79-a439-4708ed168c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a4457c-a8bd-4c88-a612-48e5f3631520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:54 devstack cinder-volume[87242]: DEBUG cinder.image.glance [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Creating Keystone auth plugin from conf {{(pid=87242) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:52:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a4457c-a8bd-4c88-a612-48e5f3631520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e42cf01c-76d2-4674-88c7-9a5aab5fec01', 'volume_name': 'volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01', 'volume_size': 1, 'image_id': '308d0dd5-8963-4465-8999-0f8d9aec838c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/308d0dd5-8963-4465-8999-0f8d9aec838c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3330a44e8d88a2766d00f55f488c2379', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2154e268e92b46c69b7f470bae9a6b7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77c49ebd422415ce5598174ee4081a321dc329afbaef9cd205d54f2c256f46e52f96b018ee7479353928a97641c05042a0f5eb6cf53e9de24def6e02e8fa458d', 'id': '308d0dd5-8963-4465-8999-0f8d9aec838c', 'created_at': datetime.datetime(2026, 9, 25, 8, 52, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 52, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/308d0dd5-8963-4465-8999-0f8d9aec838c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d972caf9-df50-4536-bef5-1af0348af60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d972caf9-df50-4536-bef5-1af0348af60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:52:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5cfbc0-250f-48c5-89fa-ce853876c683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:52:55 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Volume e42cf01c-76d2-4674-88c7-9a5aab5fec01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01', 'volume_size': 1, 'image_id': '308d0dd5-8963-4465-8999-0f8d9aec838c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/308d0dd5-8963-4465-8999-0f8d9aec838c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3330a44e8d88a2766d00f55f488c2379', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2154e268e92b46c69b7f470bae9a6b7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77c49ebd422415ce5598174ee4081a321dc329afbaef9cd205d54f2c256f46e52f96b018ee7479353928a97641c05042a0f5eb6cf53e9de24def6e02e8fa458d', 'id': '308d0dd5-8963-4465-8999-0f8d9aec838c', 'created_at': datetime.datetime(2026, 9, 25, 8, 52, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 52, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/308d0dd5-8963-4465-8999-0f8d9aec838c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 10:52:55 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Trying to clone e42cf01c-76d2-4674-88c7-9a5aab5fec01 from image 308d0dd5-8963-4465-8999-0f8d9aec838c at location (None, [{'url': 'file:///opt/stack/data/glance/images/308d0dd5-8963-4465-8999-0f8d9aec838c', 'metadata': {}}]). {{(pid=87242) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:52:55 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:52:55 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Image download 0.00 MB at 0.00 MB/s Sep 25 10:52:55 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9145e0aa-56fc-4703-88d4-1ea9618c1221]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:55 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD Sep 25 10:52:55 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:55 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:55 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD Sep 25 10:52:55 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:56 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:52:56 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Temporary image 308d0dd5-8963-4465-8999-0f8d9aec838c is fetched for user 87b73768a8ba48d3a367d940a1d1f447. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:52:56 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ddbac3-f4f9-403f-a707-f1d969b42642]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:56 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD Sep 25 10:52:56 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:56 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:56 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD Sep 25 10:52:56 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:56 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42cf01c-76d2-4674-88c7-9a5aab5fec01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154e268e92b46c69b7f470bae9a6b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:52:55Z,use_quota=True,user_id='87b73768a8ba48d3a367d940a1d1f447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f13a518d-505e-4f22-aaac-10926a6bc064),volume_type_id=f13a518d-505e-4f22-aaac-10926a6bc064)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Creating volume e42cf01c-76d2-4674-88c7-9a5aab5fec01 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:52:57 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:57 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 1073741824 Sep 25 10:52:57 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:57 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 1073741824" returned: 0 in 0.452s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:57 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 Sep 25 10:52:57 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:57 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01" returned: 0 in 0.272s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Attempting download of 308d0dd5-8963-4465-8999-0f8d9aec838c ((None, [{'url': 'file:///opt/stack/data/glance/images/308d0dd5-8963-4465-8999-0f8d9aec838c', 'metadata': {}}])) to volume e42cf01c-76d2-4674-88c7-9a5aab5fec01. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb48d428-d8cf-4817-bcd5-71b0e6530525]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_308d0dd5-8963-4465-8999-0f8d9aec838c__9ieierq {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:57 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_308d0dd5-8963-4465-8999-0f8d9aec838c__9ieierq Sep 25 10:52:57 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:58 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_308d0dd5-8963-4465-8999-0f8d9aec838c__9ieierq" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_308d0dd5-8963-4465-8999-0f8d9aec838c__9ieierq {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:58 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_308d0dd5-8963-4465-8999-0f8d9aec838c__9ieierq Sep 25 10:52:58 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:58 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_308d0dd5-8963-4465-8999-0f8d9aec838c__9ieierq" returned: 1 in 0.338s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_308d0dd5-8963-4465-8999-0f8d9aec838c__9ieierq' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:52:58 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74ac27d-0517-4a01-bcb6-abe367c87e7c]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:52:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:58 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD Sep 25 10:52:58 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:58 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:59 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD Sep 25 10:52:59 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:59 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:52:59 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] 308d0dd5-8963-4465-8999-0f8d9aec838c was raw, converting to qcow2 {{(pid=87242) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:52:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:59 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 Sep 25 10:52:59 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:52:59 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 25 10:52:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01" returned: 0 in 0.476s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:52:59 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_308d0dd5-8963-4465-8999-0f8d9aec838c_r9_cckfddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:52:59 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 10:52:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:52:59 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 1G Sep 25 10:52:59 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:00 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 1G" returned: 0 in 0.337s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:00 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Downloaded image 308d0dd5-8963-4465-8999-0f8d9aec838c ((None, [{'url': 'file:///opt/stack/data/glance/images/308d0dd5-8963-4465-8999-0f8d9aec838c', 'metadata': {}}])) to volume e42cf01c-76d2-4674-88c7-9a5aab5fec01 successfully. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 10:53:00 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Temporary image 308d0dd5-8963-4465-8999-0f8d9aec838c for user 87b73768a8ba48d3a367d940a1d1f447 is deleted. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:53:00 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Marking volume e42cf01c-76d2-4674-88c7-9a5aab5fec01 as bootable. {{(pid=87242) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 10:53:00 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Copying metadata from image 308d0dd5-8963-4465-8999-0f8d9aec838c to e42cf01c-76d2-4674-88c7-9a5aab5fec01. {{(pid=87242) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:53:00 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Creating volume glance metadata for volume e42cf01c-76d2-4674-88c7-9a5aab5fec01 backed by image 308d0dd5-8963-4465-8999-0f8d9aec838c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '308d0dd5-8963-4465-8999-0f8d9aec838c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3330a44e8d88a2766d00f55f488c2379', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87242) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:53:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5cfbc0-250f-48c5-89fa-ce853876c683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01', 'volume_size': 1, 'image_id': '308d0dd5-8963-4465-8999-0f8d9aec838c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/308d0dd5-8963-4465-8999-0f8d9aec838c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3330a44e8d88a2766d00f55f488c2379', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2154e268e92b46c69b7f470bae9a6b7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77c49ebd422415ce5598174ee4081a321dc329afbaef9cd205d54f2c256f46e52f96b018ee7479353928a97641c05042a0f5eb6cf53e9de24def6e02e8fa458d', 'id': '308d0dd5-8963-4465-8999-0f8d9aec838c', 'created_at': datetime.datetime(2026, 9, 25, 8, 52, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 52, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/308d0dd5-8963-4465-8999-0f8d9aec838c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2154ce6b-173b-4584-9bb8-ab4bb9638437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:00 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Volume volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 (e42cf01c-76d2-4674-88c7-9a5aab5fec01): created successfully Sep 25 10:53:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2154ce6b-173b-4584-9bb8-ab4bb9638437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:00 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Flow 'volume_create_manager' (0024121a-3cd1-4571-a0a4-6303da3e7206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:00 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2228aca4-eb49-4d67-aa90-b10c22e53557 tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Created volume successfully. Sep 25 10:53:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Acquiring lock "cinder-e42cf01c-76d2-4674-88c7-9a5aab5fec01-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Lock "cinder-e42cf01c-76d2-4674-88c7-9a5aab5fec01-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Acquiring lock "cinder-quobyte-e42cf01c-76d2-4674-88c7-9a5aab5fec01" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Lock "cinder-quobyte-e42cf01c-76d2-4674-88c7-9a5aab5fec01" acquired by "delete_volume" :: waited 0.015s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:01 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[573aafde-4d0c-4b17-b54f-714110dbf53e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:01 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 Sep 25 10:53:01 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:01 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01" returned: 0 in 0.407s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:01 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01 Sep 25 10:53:01 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:01 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-e42cf01c-76d2-4674-88c7-9a5aab5fec01" returned: 0 in 0.300s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Lock "cinder-quobyte-e42cf01c-76d2-4674-88c7-9a5aab5fec01" released by "delete_volume" :: held 0.757s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:01 devstack cinder-volume[87242]: WARNING cinder.quota [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:53:01 devstack cinder-volume[87242]: WARNING cinder.quota [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 10:53:02 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Created reservations ['db2940bd-8e48-4261-af47-786b7d2b9d3f', '08cdb670-5594-42a6-8195-cecfa30238b5', 'bef32691-cab0-49e0-af71-884f32500cfd', 'c6916dd9-7d7b-49ac-9f6c-16d98028b50a'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:02 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:02 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:02 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.314s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:02 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:02 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Deleted volume successfully. Sep 25 10:53:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8a4dd355-8303-46de-b2a9-78768076685b tempest-VolumeAndVolumeTypeFromImageTest-1059666018 None] Lock "cinder-e42cf01c-76d2-4674-88c7-9a5aab5fec01-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:03 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:03 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:03 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.342s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:53:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Flow 'volume_create_manager' (76298716-fb2f-4063-b7b7-e74789da34a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6affd7-a5bb-4c04-93e4-84c41cad5824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6affd7-a5bb-4c04-93e4-84c41cad5824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc58b53a-0e6e-40a4-849a-cbffc0547aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ae518685ae4376b31af1236da3dac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:07Z,use_quota=True,user_id='a3728f354c8f4eccb18a4159a2f6a081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05987f73-766f-4a5a-8573-78f1a5c2b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05987f73-766f-4a5a-8573-78f1a5c2b65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73847086-e6c1-41b8-9129-368501764ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73847086-e6c1-41b8-9129-368501764ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc58b53a-0e6e-40a4-849a-cbffc0547aff', 'volume_name': 'volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cace4329-0419-461f-aa02-7269b346f3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cace4329-0419-461f-aa02-7269b346f3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6d86fc-74e9-41d2-a58f-4d3ecb54ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:07 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Volume dc58b53a-0e6e-40a4-849a-cbffc0547aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff', 'volume_size': 1} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc58b53a-0e6e-40a4-849a-cbffc0547aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ae518685ae4376b31af1236da3dac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:07Z,use_quota=True,user_id='a3728f354c8f4eccb18a4159a2f6a081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Creating volume dc58b53a-0e6e-40a4-849a-cbffc0547aff {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:07 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:07 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff 1073741824 Sep 25 10:53:07 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:07 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff 1073741824" returned: 0 in 0.450s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:07 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff Sep 25 10:53:07 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:07 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff" returned: 0 in 0.248s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6d86fc-74e9-41d2-a58f-4d3ecb54ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bdb423-a7c3-4f7a-a883-7181dcab7356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:07 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Volume volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff (dc58b53a-0e6e-40a4-849a-cbffc0547aff): created successfully Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bdb423-a7c3-4f7a-a883-7181dcab7356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Flow 'volume_create_manager' (76298716-fb2f-4063-b7b7-e74789da34a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-73f4ab44-97b2-47ca-9afe-133872b336df tempest-CinderUnicodeTest-816557710 None] Created volume successfully. Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Flow 'volume_create_manager' (40361543-3bb9-4475-92a7-e94deff0eecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a23871-ceae-4d63-8d25-59fb4aad5c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a23871-ceae-4d63-8d25-59fb4aad5c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1452677992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612a722f-713b-44ba-9e64-09394aca5b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ae518685ae4376b31af1236da3dac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:09Z,use_quota=True,user_id='a3728f354c8f4eccb18a4159a2f6a081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4925c9e5-6c52-40a1-aed9-941c5ae5c889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4925c9e5-6c52-40a1-aed9-941c5ae5c889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690a3df7-9246-4eaf-bf0b-c0db88d59a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690a3df7-9246-4eaf-bf0b-c0db88d59a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612a722f-713b-44ba-9e64-09394aca5b02', 'volume_name': 'volume-612a722f-713b-44ba-9e64-09394aca5b02', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5c21e2-0a79-42d4-af81-0fe16a8a83b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5c21e2-0a79-42d4-af81-0fe16a8a83b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d7114b-ea01-473c-addb-1d53fb68ba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:08 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Volume 612a722f-713b-44ba-9e64-09394aca5b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612a722f-713b-44ba-9e64-09394aca5b02', 'volume_size': 1} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1452677992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612a722f-713b-44ba-9e64-09394aca5b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ae518685ae4376b31af1236da3dac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:09Z,use_quota=True,user_id='a3728f354c8f4eccb18a4159a2f6a081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Creating volume 612a722f-713b-44ba-9e64-09394aca5b02 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:08 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:08 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 1073741824 Sep 25 10:53:08 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:09 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 1073741824" returned: 0 in 0.420s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:09 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 Sep 25 10:53:09 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:09 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02" returned: 0 in 0.258s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d7114b-ea01-473c-addb-1d53fb68ba1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612a722f-713b-44ba-9e64-09394aca5b02', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55350093-c329-4ec7-93bc-6f81cceb05c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:09 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Volume volume-612a722f-713b-44ba-9e64-09394aca5b02 (612a722f-713b-44ba-9e64-09394aca5b02): created successfully Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55350093-c329-4ec7-93bc-6f81cceb05c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Flow 'volume_create_manager' (40361543-3bb9-4475-92a7-e94deff0eecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-391b6e24-d3fc-4fc7-8fed-e4cca4d8735b tempest-CinderUnicodeTest-816557710 None] Created volume successfully. Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Creating offline snapshot 2ef4f3e0-893d-409d-8299-50e5dd0fbc3b of volume 612a722f-713b-44ba-9e64-09394aca5b02 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:53:10 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e159d9-d145-4c08-91bb-643de1a871a7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:10 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 Sep 25 10:53:10 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:10 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02" returned: 0 in 0.385s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:10 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b 1G Sep 25 10:53:10 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:10 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b 1G" returned: 0 in 0.478s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612a722f-713b-44ba-9e64-09394aca5b02 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:10 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612a722f-713b-44ba-9e64-09394aca5b02 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b Sep 25 10:53:10 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:11 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612a722f-713b-44ba-9e64-09394aca5b02 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b" returned: 0 in 0.322s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:11 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b is being set with open permissions: ugo+rw Sep 25 10:53:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:11 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b Sep 25 10:53:11 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:11 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b" returned: 0 in 0.271s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:11 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.info Sep 25 10:53:11 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:11 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.info" returned: 0 in 0.290s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:11 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.info is being set with open permissions: ugo+rw Sep 25 10:53:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:11 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.info Sep 25 10:53:11 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:12 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.info" returned: 0 in 0.337s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:12 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-00dbca47-8f42-475e-97e5-b5dc16b700c2 tempest-CinderUnicodeTest-816557710 None] Create snapshot completed successfully Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Acquiring lock "cinder-2ef4f3e0-893d-409d-8299-50e5dd0fbc3b-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-2ef4f3e0-893d-409d-8299-50e5dd0fbc3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Acquiring lock "cinder-quobyte-612a722f-713b-44ba-9e64-09394aca5b02" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-quobyte-612a722f-713b-44ba-9e64-09394aca5b02" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Acquiring lock "cinder-quobyte-2ef4f3e0-893d-409d-8299-50e5dd0fbc3b" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-quobyte-2ef4f3e0-893d-409d-8299-50e5dd0fbc3b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Deleting offline snapshot 2ef4f3e0-893d-409d-8299-50e5dd0fbc3b of volume 612a722f-713b-44ba-9e64-09394aca5b02 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] snapshot_file for this snap is: volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec905b7-87ba-48a8-b30a-f154ce3c7a52]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:13 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b Sep 25 10:53:13 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:13 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b" returned: 0 in 0.432s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-612a722f-713b-44ba-9e64-09394aca5b02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[39167946-6030-4e81-82a3-2cbce047ddcd]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:13 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 Sep 25 10:53:13 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:14 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02" returned: 0 in 0.409s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:14 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b Sep 25 10:53:14 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:14 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b" returned: 0 in 0.396s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:14 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b Sep 25 10:53:14 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:14 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02.2ef4f3e0-893d-409d-8299-50e5dd0fbc3b" returned: 0 in 0.271s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-quobyte-2ef4f3e0-893d-409d-8299-50e5dd0fbc3b" released by "_delete_snapshot" :: held 1.643s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-quobyte-612a722f-713b-44ba-9e64-09394aca5b02" released by "delete_snapshot" :: held 1.672s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:14 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Created reservations ['d149f2e3-0828-4dcf-8520-0dd99d007e49', '30e73e26-cd90-44a2-a583-ce90374d03ae', 'c29d3a22-9f28-4368-9335-6ff0ab2ce48e', '449dba0a-d066-45ef-9fa0-6be0fb863c7e'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:15 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Delete snapshot completed successfully. Sep 25 10:53:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-319da08e-dcbb-42dc-ac13-b825d9f1cd30 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-2ef4f3e0-893d-409d-8299-50e5dd0fbc3b-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Acquiring lock "cinder-612a722f-713b-44ba-9e64-09394aca5b02-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-612a722f-713b-44ba-9e64-09394aca5b02-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Acquiring lock "cinder-quobyte-612a722f-713b-44ba-9e64-09394aca5b02" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-quobyte-612a722f-713b-44ba-9e64-09394aca5b02" acquired by "delete_volume" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:15 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c61a2a-731d-42d5-87be-e8420cc747c7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:15 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 Sep 25 10:53:15 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:15 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02" returned: 0 in 0.465s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:16 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02 Sep 25 10:53:16 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:16 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-612a722f-713b-44ba-9e64-09394aca5b02" returned: 0 in 0.295s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-quobyte-612a722f-713b-44ba-9e64-09394aca5b02" released by "delete_volume" :: held 0.836s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Created reservations ['1aca4f5d-31a5-46cf-8a30-01a8433b8517', '8bea350f-026e-40fd-b206-93cdd2896609', '3231bd8c-dbe7-4dd3-aa53-977e8e4e07bf', '47174456-75c0-4ae8-bb26-ebf364c5fd75'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:16 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:16 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Acquiring lock "cinder-dc58b53a-0e6e-40a4-849a-cbffc0547aff-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-dc58b53a-0e6e-40a4-849a-cbffc0547aff-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Acquiring lock "cinder-quobyte-dc58b53a-0e6e-40a4-849a-cbffc0547aff" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-quobyte-dc58b53a-0e6e-40a4-849a-cbffc0547aff" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c313c445-2983-406a-ac5e-f3082810ea4a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:16 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.367s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Deleted volume successfully. Sep 25 10:53:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c5f766b-0d26-43ad-9239-4d2c4864aeb7 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-612a722f-713b-44ba-9e64-09394aca5b02-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:16 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff Sep 25 10:53:16 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:17 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff" returned: 0 in 0.441s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:17 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff Sep 25 10:53:17 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:17 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-dc58b53a-0e6e-40a4-849a-cbffc0547aff" returned: 0 in 0.280s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-quobyte-dc58b53a-0e6e-40a4-849a-cbffc0547aff" released by "delete_volume" :: held 0.791s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Created reservations ['dbd30e08-b88c-41af-9c9e-3c3ba4f7fb3c', 'c540338c-470d-4055-87d0-1bcf2002c511', '2510f46d-2238-4587-9194-a25cc5c79242', '73c502c8-a605-40e6-b293-57b547b741c1'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:17 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:17 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:18 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.362s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:18 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Deleted volume successfully. Sep 25 10:53:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7f6870e8-898b-4819-be04-91ca4fa4f853 tempest-CinderUnicodeTest-816557710 None] Lock "cinder-dc58b53a-0e6e-40a4-849a-cbffc0547aff-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:27 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=40,cinder:SELECT=36,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:53:28 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=36,cinder:INSERT=17,cinder:UPDATE=43,cinder:DELETE=4 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (a08be02c-13ca-4f73-96d4-92eb0b8ad18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b115ce-6030-4e6a-b70f-84ef29ac06ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b115ce-6030-4e6a-b70f-84ef29ac06ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1463522737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96525a5-7b6e-4d51-b469-cd60e553227c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:31Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0773723d-2692-4c2a-82d5-b3c007990780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0773723d-2692-4c2a-82d5-b3c007990780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ba80f2-3be5-4873-b67b-1234879aa251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ba80f2-3be5-4873-b67b-1234879aa251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96525a5-7b6e-4d51-b469-cd60e553227c', 'volume_name': 'volume-f96525a5-7b6e-4d51-b469-cd60e553227c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95e2cf8-abcb-4fab-9563-ad3e612f3e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95e2cf8-abcb-4fab-9563-ad3e612f3e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fb207d-96dc-4b86-8f24-203d818ef6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:31 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume f96525a5-7b6e-4d51-b469-cd60e553227c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96525a5-7b6e-4d51-b469-cd60e553227c', 'volume_size': 1} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1463522737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96525a5-7b6e-4d51-b469-cd60e553227c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:31Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Creating volume f96525a5-7b6e-4d51-b469-cd60e553227c {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:31 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:31 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c 1073741824 Sep 25 10:53:31 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Flow 'volume_create_manager' (db01a397-1189-4030-a080-a1a87d47977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a88ee9e-370e-4d93-8233-a300595c55e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a88ee9e-370e-4d93-8233-a300595c55e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4ce290-76d3-4797-b72b-6436a3c69d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac4662685ef4463aab219f1e2f06d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:32Z,use_quota=True,user_id='8535a81197e64a7094e1451d1c3fb1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0827993e-be35-40a3-b6a0-c6d99700b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0827993e-be35-40a3-b6a0-c6d99700b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50522dbe-d0de-4b37-b473-813f0bb266b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50522dbe-d0de-4b37-b473-813f0bb266b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d4ce290-76d3-4797-b72b-6436a3c69d2e', 'volume_name': 'volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a64fef5-55f9-40e6-ba31-b4b2f288670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a64fef5-55f9-40e6-ba31-b4b2f288670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900848d3-05c2-4856-8710-8738297f23b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:31 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Volume 9d4ce290-76d3-4797-b72b-6436a3c69d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e', 'volume_size': 1} Sep 25 10:53:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (6c08a1d1-9db7-430d-9606-0f174313ef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb95e71-cb4f-4777-a19c-493f1174a3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb95e71-cb4f-4777-a19c-493f1174a3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1816283333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5eeeb17-1d26-4656-9d07-b811fc2c38b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:32Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb42119-83f7-41dd-b15a-3f82a40dd961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:32 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb42119-83f7-41dd-b15a-3f82a40dd961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5625d3dc-f111-4d5b-9239-132dc5ecc8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5625d3dc-f111-4d5b-9239-132dc5ecc8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5eeeb17-1d26-4656-9d07-b811fc2c38b7', 'volume_name': 'volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c42ce4-0675-4c10-b362-bbdd75922723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c42ce4-0675-4c10-b362-bbdd75922723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebcbe5f-cdcd-4155-acfe-b1a21a849c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:32 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume a5eeeb17-1d26-4656-9d07-b811fc2c38b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7', 'volume_size': 1} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c 1073741824" returned: 0 in 0.750s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:32 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c Sep 25 10:53:32 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:32 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c" returned: 0 in 0.293s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4ce290-76d3-4797-b72b-6436a3c69d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac4662685ef4463aab219f1e2f06d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:32Z,use_quota=True,user_id='8535a81197e64a7094e1451d1c3fb1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Creating volume 9d4ce290-76d3-4797-b72b-6436a3c69d2e {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:32 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:32 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e 1073741824 Sep 25 10:53:32 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fb207d-96dc-4b86-8f24-203d818ef6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96525a5-7b6e-4d51-b469-cd60e553227c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dad76a-79ed-4089-ba3c-fdc7ef154018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:32 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume volume-f96525a5-7b6e-4d51-b469-cd60e553227c (f96525a5-7b6e-4d51-b469-cd60e553227c): created successfully Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dad76a-79ed-4089-ba3c-fdc7ef154018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (a08be02c-13ca-4f73-96d4-92eb0b8ad18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:32 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e2084b31-7b78-4d86-8f43-4a9103d9a9e5 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created volume successfully. Sep 25 10:53:33 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e 1073741824" returned: 0 in 0.560s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:33 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e Sep 25 10:53:33 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:33 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e" returned: 0 in 0.302s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.268s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1816283333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5eeeb17-1d26-4656-9d07-b811fc2c38b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:32Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Creating volume a5eeeb17-1d26-4656-9d07-b811fc2c38b7 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:33 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900848d3-05c2-4856-8710-8738297f23b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:33 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 1073741824 Sep 25 10:53:33 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010e68df-aeb1-4727-b6c5-4b47aae8cd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:33 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Volume volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e (9d4ce290-76d3-4797-b72b-6436a3c69d2e): created successfully Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010e68df-aeb1-4727-b6c5-4b47aae8cd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:33 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Flow 'volume_create_manager' (db01a397-1189-4030-a080-a1a87d47977a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:33 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-bdb4fd73-67c4-4db0-93d6-2ad5f59247b4 tempest-CinderUnicodeTest-686043498 None] Created volume successfully. Sep 25 10:53:34 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 1073741824" returned: 0 in 0.716s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:34 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 Sep 25 10:53:34 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (6eb7f4c6-cad9-4adc-b59e-31d4bdf7f76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe117b9-5fcf-4e59-9ae6-e00fb9815b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe117b9-5fcf-4e59-9ae6-e00fb9815b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2030852289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ce0a2b-217c-40c1-ac82-dff73b1e5e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:34Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387f1026-a641-448d-916c-1274c022be5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387f1026-a641-448d-916c-1274c022be5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccd7e74-b884-4716-894a-4dbe4e473eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccd7e74-b884-4716-894a-4dbe4e473eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ce0a2b-217c-40c1-ac82-dff73b1e5e09', 'volume_name': 'volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bbb234-9a62-4c25-833c-3c9d0b5446ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bbb234-9a62-4c25-833c-3c9d0b5446ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3febfc-d669-4cde-888e-11fd51f79179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:34 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume 00ce0a2b-217c-40c1-ac82-dff73b1e5e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09', 'volume_size': 1} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:34 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" returned: 0 in 0.386s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.068s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2030852289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ce0a2b-217c-40c1-ac82-dff73b1e5e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:34Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Creating volume 00ce0a2b-217c-40c1-ac82-dff73b1e5e09 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:34 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:34 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09 1073741824 Sep 25 10:53:34 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebcbe5f-cdcd-4155-acfe-b1a21a849c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5feb675e-5520-4aac-8925-602aee08da52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:34 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 (a5eeeb17-1d26-4656-9d07-b811fc2c38b7): created successfully Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5feb675e-5520-4aac-8925-602aee08da52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (6c08a1d1-9db7-430d-9606-0f174313ef87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:34 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-42a908c9-1511-4533-8ff2-ee2d3e7eee2e tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created volume successfully. Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (f40181d1-0802-4e60-8ed6-f5ebd0ffdb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05fc8a7-2879-4d37-b3aa-d75dd8a9a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05fc8a7-2879-4d37-b3aa-d75dd8a9a61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1502351662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f91a2493-4116-4abd-af73-918e50884b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:35Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c019846a-6cb0-44ba-a5fc-2aca907889b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c019846a-6cb0-44ba-a5fc-2aca907889b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f048d83-9fa4-4f62-92ad-700accb20d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f048d83-9fa4-4f62-92ad-700accb20d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f91a2493-4116-4abd-af73-918e50884b5a', 'volume_name': 'volume-f91a2493-4116-4abd-af73-918e50884b5a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc49aac9-d1cc-4564-9488-850c3ed5c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc49aac9-d1cc-4564-9488-850c3ed5c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c50b2b-d953-44b0-b1b8-8870a2aeffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:35 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume f91a2493-4116-4abd-af73-918e50884b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f91a2493-4116-4abd-af73-918e50884b5a', 'volume_size': 1} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:35 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09 1073741824" returned: 0 in 0.943s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:35 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09 Sep 25 10:53:35 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:36 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09" returned: 0 in 0.546s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1502351662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f91a2493-4116-4abd-af73-918e50884b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:35Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Creating volume f91a2493-4116-4abd-af73-918e50884b5a {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:36 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:36 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a 1073741824 Sep 25 10:53:36 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3febfc-d669-4cde-888e-11fd51f79179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620393b7-f9a5-4831-87ae-82f695a67b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09 (00ce0a2b-217c-40c1-ac82-dff73b1e5e09): created successfully Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620393b7-f9a5-4831-87ae-82f695a67b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (6eb7f4c6-cad9-4adc-b59e-31d4bdf7f76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Flow 'volume_create_manager' (48503bd7-7ad4-411c-a4d1-87c468dbf7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cd886d-4f74-40ff-83dd-074e345192bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (a57b5c9c-c521-423e-888b-925a36ef7fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9270d010-fa0d-4fb3-9efc-17212b6e5c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-97b7369d-e359-413a-b69b-312ea0f835ed tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created volume successfully. Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9270d010-fa0d-4fb3-9efc-17212b6e5c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1456145024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbbd5ce-da9d-4805-a929-6655de22012e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:36Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265f01b2-fe51-4b0d-9591-187d546c3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265f01b2-fe51-4b0d-9591-187d546c3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c8f663-eef9-437a-be59-dc8e18bb97bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c8f663-eef9-437a-be59-dc8e18bb97bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbbd5ce-da9d-4805-a929-6655de22012e', 'volume_name': 'volume-2cbbd5ce-da9d-4805-a929-6655de22012e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75944722-6557-4dc5-8f53-1f2653d8f815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75944722-6557-4dc5-8f53-1f2653d8f815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cac736f-8cfa-4beb-bc08-e601560ea515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume 2cbbd5ce-da9d-4805-a929-6655de22012e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbbd5ce-da9d-4805-a929-6655de22012e', 'volume_size': 1} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cd886d-4f74-40ff-83dd-074e345192bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-239327704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac4662685ef4463aab219f1e2f06d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:36Z,use_quota=True,user_id='8535a81197e64a7094e1451d1c3fb1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18360f0-8716-4e2e-a3a2-3454a579ee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18360f0-8716-4e2e-a3a2-3454a579ee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d69282-fe89-427b-a021-4539a4b9f1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d69282-fe89-427b-a021-4539a4b9f1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a', 'volume_name': 'volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf68a43-4264-4dff-b51c-3939519cbd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf68a43-4264-4dff-b51c-3939519cbd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bd6fd7-31c5-4488-a71c-d8dad375fc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:36 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Volume bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a', 'volume_size': 1} Sep 25 10:53:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:37 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (be786789-a94f-4227-8776-f083e1d882de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7aa14d-1dca-490e-a3b3-c5143d3673ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a 1073741824" returned: 0 in 0.956s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7aa14d-1dca-490e-a3b3-c5143d3673ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-105970974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cf7dcf-323f-4f22-bc90-3211d064a666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:37Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f567c5d-2b69-4e59-bc19-628fe02502f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f567c5d-2b69-4e59-bc19-628fe02502f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb6e176-5f13-49b3-8d0e-42412e0b3ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb6e176-5f13-49b3-8d0e-42412e0b3ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1cf7dcf-323f-4f22-bc90-3211d064a666', 'volume_name': 'volume-b1cf7dcf-323f-4f22-bc90-3211d064a666', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d97512-9310-49d1-991b-a8f2b50e7d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d97512-9310-49d1-991b-a8f2b50e7d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c3da72-00dd-4a52-b125-1c627bc35795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume b1cf7dcf-323f-4f22-bc90-3211d064a666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1cf7dcf-323f-4f22-bc90-3211d064a666', 'volume_size': 1} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:37 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a Sep 25 10:53:37 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Flow 'volume_create_manager' (5a56c8e3-b1f0-4b3f-b2ff-de5feb1b9599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f056f2c4-6f99-4db4-a285-ea010dc94a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f056f2c4-6f99-4db4-a285-ea010dc94a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d516b477-7d0f-46b8-a799-2f484383ebf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e966f42079e4c68a5ea3524bfcc1f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:38Z,use_quota=True,user_id='4d7ee77aec3a46caaaeea726eef27a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f8e885c-e343-4eb8-918c-e27d888c0c07),volume_type_id=1f8e885c-e343-4eb8-918c-e27d888c0c07)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd4bb5e-c865-459f-a25a-d3b7ab913167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd4bb5e-c865-459f-a25a-d3b7ab913167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f755e0a-ee28-41d4-ba17-a74c76265175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.image.glance [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Creating Keystone auth plugin from conf {{(pid=87242) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (362fb076-d82a-4c2d-ad7c-2c3f8f5e57a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a0f96a-88c0-4777-8385-10658d8325ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a0f96a-88c0-4777-8385-10658d8325ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567942705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3077f885-c7b2-4cbb-9bea-2140455f0ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:38Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ec4673-e230-401e-995c-6958ec55a508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ec4673-e230-401e-995c-6958ec55a508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d13593c-9fd4-4acf-bd19-3582e523d90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d13593c-9fd4-4acf-bd19-3582e523d90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3077f885-c7b2-4cbb-9bea-2140455f0ed7', 'volume_name': 'volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea8a799-36c2-44b0-b935-7c87d554ffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea8a799-36c2-44b0-b935-7c87d554ffd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d5df80-a99d-41a2-ae58-a870046cfb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:38 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume 3077f885-c7b2-4cbb-9bea-2140455f0ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7', 'volume_size': 1} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a" returned: 0 in 0.484s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.273s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1456145024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbbd5ce-da9d-4805-a929-6655de22012e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:36Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Creating volume 2cbbd5ce-da9d-4805-a929-6655de22012e {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:38 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c50b2b-d953-44b0-b1b8-8870a2aeffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f91a2493-4116-4abd-af73-918e50884b5a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4a58c4-f9e7-49b9-94fa-e3d99225d1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:38 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e 1073741824 Sep 25 10:53:38 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:38 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume volume-f91a2493-4116-4abd-af73-918e50884b5a (f91a2493-4116-4abd-af73-918e50884b5a): created successfully Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4a58c4-f9e7-49b9-94fa-e3d99225d1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (f40181d1-0802-4e60-8ed6-f5ebd0ffdb11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:38 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-66938d1a-cdbc-4182-bbd1-216dafe0fe59 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created volume successfully. Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f755e0a-ee28-41d4-ba17-a74c76265175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd516b477-7d0f-46b8-a799-2f484383ebf6', 'volume_name': 'volume-d516b477-7d0f-46b8-a799-2f484383ebf6', 'volume_size': 1, 'image_id': '90d52daf-1955-4508-922f-9aee71578aca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d52daf-1955-4508-922f-9aee71578aca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2b253c4055e4fd78f8d8484c1323267', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e966f42079e4c68a5ea3524bfcc1f01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2c0a30254142bb67213795c028a422ce73c2797549a1ccdbd57cb03fd2b960ab55983d8cbc320f92fc5e5690fcab3942d17f4b7e2f33cec881dda467fb7047b', 'id': '90d52daf-1955-4508-922f-9aee71578aca', 'created_at': datetime.datetime(2026, 9, 25, 8, 53, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 53, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d52daf-1955-4508-922f-9aee71578aca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a4b3d3-7739-486a-948a-83c1fb9e5f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a4b3d3-7739-486a-948a-83c1fb9e5f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fa5d07-de92-4cd1-8b24-0281ddafc1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:38 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Volume d516b477-7d0f-46b8-a799-2f484383ebf6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d516b477-7d0f-46b8-a799-2f484383ebf6', 'volume_size': 1, 'image_id': '90d52daf-1955-4508-922f-9aee71578aca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d52daf-1955-4508-922f-9aee71578aca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2b253c4055e4fd78f8d8484c1323267', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e966f42079e4c68a5ea3524bfcc1f01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2c0a30254142bb67213795c028a422ce73c2797549a1ccdbd57cb03fd2b960ab55983d8cbc320f92fc5e5690fcab3942d17f4b7e2f33cec881dda467fb7047b', 'id': '90d52daf-1955-4508-922f-9aee71578aca', 'created_at': datetime.datetime(2026, 9, 25, 8, 53, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 53, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d52daf-1955-4508-922f-9aee71578aca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Trying to clone d516b477-7d0f-46b8-a799-2f484383ebf6 from image 90d52daf-1955-4508-922f-9aee71578aca at location (None, [{'url': 'file:///opt/stack/data/glance/images/90d52daf-1955-4508-922f-9aee71578aca', 'metadata': {}}]). {{(pid=87242) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:53:38 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Image download 0.00 MB at 0.00 MB/s Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3ea7a5-f0ab-469d-a1b8-e98b131cd4f1]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:38 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD Sep 25 10:53:38 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:38 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e 1073741824" returned: 0 in 0.831s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:38 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e Sep 25 10:53:38 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:39 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:39 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e" returned: 0 in 0.313s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.405s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-239327704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac4662685ef4463aab219f1e2f06d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:36Z,use_quota=True,user_id='8535a81197e64a7094e1451d1c3fb1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Creating volume bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:39 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:39 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a 1073741824 Sep 25 10:53:39 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cac736f-8cfa-4beb-bc08-e601560ea515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbbd5ce-da9d-4805-a929-6655de22012e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d6a07c-0dd6-4ac3-a5f1-b3c9794f9b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:39 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume volume-2cbbd5ce-da9d-4805-a929-6655de22012e (2cbbd5ce-da9d-4805-a929-6655de22012e): created successfully Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d6a07c-0dd6-4ac3-a5f1-b3c9794f9b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:39 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD Sep 25 10:53:39 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (a57b5c9c-c521-423e-888b-925a36ef7fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:39 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f89491c9-34e1-4932-bfb3-6f1411ed6e68 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created volume successfully. Sep 25 10:53:39 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD" returned: 1 in 0.447s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Temporary image 90d52daf-1955-4508-922f-9aee71578aca is fetched for user 4d7ee77aec3a46caaaeea726eef27a96. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2507f3-b48e-4b86-8aa0-a01cd79942c3]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:39 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD Sep 25 10:53:39 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:39 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a 1073741824" returned: 0 in 0.697s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:40 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a Sep 25 10:53:40 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:40 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:40 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD Sep 25 10:53:40 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:40 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" returned: 0 in 0.329s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.135s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bd6fd7-31c5-4488-a71c-d8dad375fc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa03617-eae0-4c0b-9acc-9edc9a7308f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Creating offline snapshot 6e6c6895-497f-43cc-be9b-db14b8f69dfe of volume a5eeeb17-1d26-4656-9d07-b811fc2c38b7 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:53:40 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Volume volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a (bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a): created successfully Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa03617-eae0-4c0b-9acc-9edc9a7308f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Flow 'volume_create_manager' (48503bd7-7ad4-411c-a4d1-87c468dbf7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ce9c3-9890-4970-98da-7acc82a58b94]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:40 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-956c0076-e4ab-4028-a06c-325bbcce3821 tempest-CinderUnicodeTest-686043498 None] Created volume successfully. Sep 25 10:53:40 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 Sep 25 10:53:40 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:40 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:40 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" returned: 0 in 0.512s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:40 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe 1G Sep 25 10:53:40 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:41 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe 1G" returned: 0 in 0.555s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:41 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe Sep 25 10:53:41 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:41 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe" returned: 0 in 0.328s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:41 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe is being set with open permissions: ugo+rw Sep 25 10:53:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:41 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe Sep 25 10:53:41 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:42 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe" returned: 0 in 0.311s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:42 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.info Sep 25 10:53:42 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:42 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.info" returned: 0 in 0.326s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:42 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.info is being set with open permissions: ugo+rw Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:42 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.info Sep 25 10:53:42 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:42 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.info" returned: 0 in 0.298s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.321s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-105970974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cf7dcf-323f-4f22-bc90-3211d064a666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:37Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Creating volume b1cf7dcf-323f-4f22-bc90-3211d064a666 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:42 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:42 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666 1073741824 Sep 25 10:53:42 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:42 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c458e8e8-c6c5-4710-8a0d-9c0d639df061 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Create snapshot completed successfully Sep 25 10:53:43 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666 1073741824" returned: 0 in 0.517s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:43 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666 Sep 25 10:53:43 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:43 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666" returned: 0 in 0.271s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.645s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567942705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3077f885-c7b2-4cbb-9bea-2140455f0ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ddf57e11104e8fa3c7f0c1f537cf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:38Z,use_quota=True,user_id='1e574e359e724fdda175076ef77382ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Creating volume 3077f885-c7b2-4cbb-9bea-2140455f0ed7 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:43 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:43 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7 1073741824 Sep 25 10:53:43 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c3da72-00dd-4a52-b125-1c627bc35795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1cf7dcf-323f-4f22-bc90-3211d064a666', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bea1ac-2950-4f32-9e83-8ce9cf6fce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:43 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume volume-b1cf7dcf-323f-4f22-bc90-3211d064a666 (b1cf7dcf-323f-4f22-bc90-3211d064a666): created successfully Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bea1ac-2950-4f32-9e83-8ce9cf6fce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (be786789-a94f-4227-8776-f083e1d882de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:43 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7151937d-dc32-4cb8-9553-95f2c152ab61 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created volume successfully. Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (a9e202e8-b699-4103-bfe2-14c870dccf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3b0366-883b-4610-82d1-eea51fee7bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:44 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3b0366-883b-4610-82d1-eea51fee7bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2034230121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf544db-3c76-42d9-bdc3-0876d20f849f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:44Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57865e7b-ff78-4fab-bb17-10bd4d6b577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57865e7b-ff78-4fab-bb17-10bd4d6b577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad9bc57-527a-4ef8-86cb-e469bea0e6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad9bc57-527a-4ef8-86cb-e469bea0e6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf544db-3c76-42d9-bdc3-0876d20f849f', 'volume_name': 'volume-faf544db-3c76-42d9-bdc3-0876d20f849f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fff5658-42ee-48b1-b14d-f23ed50b487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fff5658-42ee-48b1-b14d-f23ed50b487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c463245a-862b-4ac6-b663-2eb8ea2d6d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:44 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume faf544db-3c76-42d9-bdc3-0876d20f849f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf544db-3c76-42d9-bdc3-0876d20f849f', 'volume_size': 1} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7 1073741824" returned: 0 in 0.713s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:44 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7 Sep 25 10:53:44 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (16b8ed17-8e7f-414c-b6d5-080566b4b79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb0a275-7027-4c1b-8e12-b9e0a9aff003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb0a275-7027-4c1b-8e12-b9e0a9aff003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2054975726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93436e20-5945-4baf-bd80-b24ea1160755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:45Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1302583b-a6a9-47a9-af79-1b74fa1150dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1302583b-a6a9-47a9-af79-1b74fa1150dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b89802-a826-4c75-b5ca-8bb0258a36f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:44 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b89802-a826-4c75-b5ca-8bb0258a36f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93436e20-5945-4baf-bd80-b24ea1160755', 'volume_name': 'volume-93436e20-5945-4baf-bd80-b24ea1160755', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e430564e-8bb9-4b74-8736-aea9073b62cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e430564e-8bb9-4b74-8736-aea9073b62cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ea2c09-6a10-4892-9056-440417ee5db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:44 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume 93436e20-5945-4baf-bd80-b24ea1160755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93436e20-5945-4baf-bd80-b24ea1160755', 'volume_size': 1} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7" returned: 0 in 0.497s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.367s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d516b477-7d0f-46b8-a799-2f484383ebf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e966f42079e4c68a5ea3524bfcc1f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:38Z,use_quota=True,user_id='4d7ee77aec3a46caaaeea726eef27a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f8e885c-e343-4eb8-918c-e27d888c0c07),volume_type_id=1f8e885c-e343-4eb8-918c-e27d888c0c07)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Creating volume d516b477-7d0f-46b8-a799-2f484383ebf6 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:44 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:44 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 1073741824 Sep 25 10:53:44 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d5df80-a99d-41a2-ae58-a870046cfb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef651e04-6eab-46d2-8ec0-05460cbe6103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:45 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Volume volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7 (3077f885-c7b2-4cbb-9bea-2140455f0ed7): created successfully Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef651e04-6eab-46d2-8ec0-05460cbe6103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Flow 'volume_create_manager' (362fb076-d82a-4c2d-ad7c-2c3f8f5e57a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:45 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4d941c94-064f-4ddc-80b9-10c7ce657205 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created volume successfully. Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (c6494832-3369-496d-ab88-8d4cd257fe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f493b3-a54f-4194-a7ea-ae4f4cf716c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f493b3-a54f-4194-a7ea-ae4f4cf716c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664755308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31feaba8-323c-4ab9-af3c-396e2dcaa596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:45Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c127c924-2514-445b-ba5a-b413ed139a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c127c924-2514-445b-ba5a-b413ed139a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f60f2e6-b5b4-4d49-8053-c0d51b73ab2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f60f2e6-b5b4-4d49-8053-c0d51b73ab2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31feaba8-323c-4ab9-af3c-396e2dcaa596', 'volume_name': 'volume-31feaba8-323c-4ab9-af3c-396e2dcaa596', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122da9ab-1d63-4405-9134-27c5f5eaeeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122da9ab-1d63-4405-9134-27c5f5eaeeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32620f36-f501-4d22-9806-5a957c6201e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:45 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume 31feaba8-323c-4ab9-af3c-396e2dcaa596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31feaba8-323c-4ab9-af3c-396e2dcaa596', 'volume_size': 1} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:45 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 1073741824" returned: 0 in 0.741s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-3077f885-c7b2-4cbb-9bea-2140455f0ed7-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:45 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 Sep 25 10:53:45 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-3077f885-c7b2-4cbb-9bea-2140455f0ed7-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (82bb6506-b757-4791-b1c6-0ecb033b38a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b911c92-6949-4d51-833d-52008eab12b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b911c92-6949-4d51-833d-52008eab12b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1607584022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:46Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb092ee-6ac1-401e-bbd7-48c6dd09c1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:45 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb092ee-6ac1-401e-bbd7-48c6dd09c1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0ce28a-afc9-49ce-9c41-55d93f37a9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0ce28a-afc9-49ce-9c41-55d93f37a9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28', 'volume_name': 'volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd6534d-da71-4538-a8c6-7d8781ff7ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd6534d-da71-4538-a8c6-7d8781ff7ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567c63db-f4d0-4a84-8825-9a9db195fb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:46 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28', 'volume_size': 1} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-quobyte-3077f885-c7b2-4cbb-9bea-2140455f0ed7" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-3077f885-c7b2-4cbb-9bea-2140455f0ed7" acquired by "delete_volume" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e117e94e-f51f-45b6-a7da-fee55eb6adb1]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:46 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6" returned: 0 in 0.402s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.961s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Creating offline snapshot cb8e3f83-e9b1-4214-9ddd-268959ad2dba of volume bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Attempting download of 90d52daf-1955-4508-922f-9aee71578aca ((None, [{'url': 'file:///opt/stack/data/glance/images/90d52daf-1955-4508-922f-9aee71578aca', 'metadata': {}}])) to volume d516b477-7d0f-46b8-a799-2f484383ebf6. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aabef08-adc8-4f01-9f4b-6f611f57e411]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:46 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7 Sep 25 10:53:46 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b1ec58-bf2b-45dd-9e99-6eeec287bca6]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d52daf-1955-4508-922f-9aee71578aca_7cs4dpty {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:46 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a Sep 25 10:53:46 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:53:46 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d52daf-1955-4508-922f-9aee71578aca_7cs4dpty Sep 25 10:53:46 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (5dfcf710-dcbf-422d-bc8f-a312e0c0cbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06db19b3-3d1a-4f17-bb5b-5e27f2e876a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06db19b3-3d1a-4f17-bb5b-5e27f2e876a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1066558109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f43f55-9cbd-4358-bada-3dd80a7cd98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:47Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9fa9f6-8c88-4a94-872a-a32467451e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9fa9f6-8c88-4a94-872a-a32467451e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeb2533-1d86-4057-b4b0-d568b0980c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeb2533-1d86-4057-b4b0-d568b0980c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f43f55-9cbd-4358-bada-3dd80a7cd98c', 'volume_name': 'volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f71c04-7d2a-4d1a-bf85-cd8a2dd9eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f71c04-7d2a-4d1a-bf85-cd8a2dd9eb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2857b01-6c30-48cb-9674-fdfb92dcbf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:46 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume f2f43f55-9cbd-4358-bada-3dd80a7cd98c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c', 'volume_size': 1} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:46 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7" returned: 0 in 0.586s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:46 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7 Sep 25 10:53:46 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:46 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" returned: 0 in 0.639s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:46 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d52daf-1955-4508-922f-9aee71578aca_7cs4dpty" returned: 0 in 0.554s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d52daf-1955-4508-922f-9aee71578aca_7cs4dpty {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:46 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba 1G Sep 25 10:53:46 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:47 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d52daf-1955-4508-922f-9aee71578aca_7cs4dpty Sep 25 10:53:47 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:47 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3077f885-c7b2-4cbb-9bea-2140455f0ed7" returned: 0 in 0.496s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-3077f885-c7b2-4cbb-9bea-2140455f0ed7" released by "delete_volume" :: held 1.157s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created reservations ['84998e20-f996-4195-ac2f-3550dd7965c2', '6f5c7ac9-b763-451b-b5a6-9138addbadf5', '33b4849e-33df-46a1-b2a0-527110713330', '36c8266a-6f0b-4cf0-aeee-c06630781dce'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:47 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d52daf-1955-4508-922f-9aee71578aca_7cs4dpty" returned: 1 in 0.560s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d52daf-1955-4508-922f-9aee71578aca_7cs4dpty' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[025febfd-6699-4662-899e-567685b6e402]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:47 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:47 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:47 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD Sep 25 10:53:47 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:47 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba 1G" returned: 0 in 0.758s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:47 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba Sep 25 10:53:47 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:47 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.309s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:47 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Deleted volume successfully. Sep 25 10:53:47 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-65c179f7-71d9-4d22-9565-b49e7facbe16 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-3077f885-c7b2-4cbb-9bea-2140455f0ed7-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:48 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:48 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba" returned: 0 in 0.426s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:48 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba is being set with open permissions: ugo+rw Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:48 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba Sep 25 10:53:48 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:48 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD Sep 25 10:53:48 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-b1cf7dcf-323f-4f22-bc90-3211d064a666-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-b1cf7dcf-323f-4f22-bc90-3211d064a666-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-quobyte-b1cf7dcf-323f-4f22-bc90-3211d064a666" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-b1cf7dcf-323f-4f22-bc90-3211d064a666" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a29e0f1-9600-4f36-b241-8fce6aae68f1]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:48 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba" returned: 0 in 0.409s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:48 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666 Sep 25 10:53:48 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:48 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD" returned: 1 in 0.615s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] 90d52daf-1955-4508-922f-9aee71578aca was raw, converting to qcow2 {{(pid=87242) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:48 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 Sep 25 10:53:48 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:48 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.info Sep 25 10:53:48 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:48 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666" returned: 0 in 0.530s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:48 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666 Sep 25 10:53:48 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:48 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.info" returned: 0 in 0.313s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:48 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.info is being set with open permissions: ugo+rw Sep 25 10:53:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:49 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.info Sep 25 10:53:49 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:49 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b1cf7dcf-323f-4f22-bc90-3211d064a666" returned: 0 in 0.349s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:49 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-b1cf7dcf-323f-4f22-bc90-3211d064a666" released by "delete_volume" :: held 0.950s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6" returned: 0 in 0.666s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90d52daf-1955-4508-922f-9aee71578aca_187t3hzidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:53:49 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:49 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:49 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 1G Sep 25 10:53:49 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.info" returned: 0 in 0.364s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.208s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2034230121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf544db-3c76-42d9-bdc3-0876d20f849f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:44Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Creating volume faf544db-3c76-42d9-bdc3-0876d20f849f {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:49 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:49 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f 1073741824 Sep 25 10:53:49 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:49 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5b209326-3e2b-4026-8feb-3d57b38946ae tempest-CinderUnicodeTest-686043498 None] Create snapshot completed successfully Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created reservations ['c8714d5c-f25d-4dbe-8ad4-7b6215f98783', '8a6211d9-10ad-4e17-bd03-d55f7366f50a', '86a2f0ea-d842-47de-a223-4f71d77e7cd5', 'adab3704-da42-46e4-a9ec-69ee85c6c724'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:49 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:49 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:49 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 1G" returned: 0 in 0.539s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Downloaded image 90d52daf-1955-4508-922f-9aee71578aca ((None, [{'url': 'file:///opt/stack/data/glance/images/90d52daf-1955-4508-922f-9aee71578aca', 'metadata': {}}])) to volume d516b477-7d0f-46b8-a799-2f484383ebf6 successfully. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Temporary image 90d52daf-1955-4508-922f-9aee71578aca for user 4d7ee77aec3a46caaaeea726eef27a96 is deleted. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Marking volume d516b477-7d0f-46b8-a799-2f484383ebf6 as bootable. {{(pid=87242) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Acquiring lock "cinder-cb8e3f83-e9b1-4214-9ddd-268959ad2dba-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Copying metadata from image 90d52daf-1955-4508-922f-9aee71578aca to d516b477-7d0f-46b8-a799-2f484383ebf6. {{(pid=87242) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Creating volume glance metadata for volume d516b477-7d0f-46b8-a799-2f484383ebf6 backed by image 90d52daf-1955-4508-922f-9aee71578aca with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '90d52daf-1955-4508-922f-9aee71578aca', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e2b253c4055e4fd78f8d8484c1323267', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87242) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Lock "cinder-cb8e3f83-e9b1-4214-9ddd-268959ad2dba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Acquiring lock "cinder-quobyte-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:49 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.414s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Lock "cinder-quobyte-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Acquiring lock "cinder-quobyte-cb8e3f83-e9b1-4214-9ddd-268959ad2dba" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Deleted volume successfully. Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Lock "cinder-quobyte-cb8e3f83-e9b1-4214-9ddd-268959ad2dba" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Deleting offline snapshot cb8e3f83-e9b1-4214-9ddd-268959ad2dba of volume bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] snapshot_file for this snap is: volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-979bc4e5-01c2-47f2-a447-c48f89fa5d7d tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-b1cf7dcf-323f-4f22-bc90-3211d064a666-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a04726-25e8-4600-b000-64c04194c39f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:50 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fa5d07-de92-4cd1-8b24-0281ddafc1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d516b477-7d0f-46b8-a799-2f484383ebf6', 'volume_size': 1, 'image_id': '90d52daf-1955-4508-922f-9aee71578aca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d52daf-1955-4508-922f-9aee71578aca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2b253c4055e4fd78f8d8484c1323267', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e966f42079e4c68a5ea3524bfcc1f01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2c0a30254142bb67213795c028a422ce73c2797549a1ccdbd57cb03fd2b960ab55983d8cbc320f92fc5e5690fcab3942d17f4b7e2f33cec881dda467fb7047b', 'id': '90d52daf-1955-4508-922f-9aee71578aca', 'created_at': datetime.datetime(2026, 9, 25, 8, 53, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 53, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d52daf-1955-4508-922f-9aee71578aca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9c8386-c164-42e8-8de6-1a250ad06299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f 1073741824" returned: 0 in 0.728s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:50 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Volume volume-d516b477-7d0f-46b8-a799-2f484383ebf6 (d516b477-7d0f-46b8-a799-2f484383ebf6): created successfully Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9c8386-c164-42e8-8de6-1a250ad06299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Flow 'volume_create_manager' (5a56c8e3-b1f0-4b3f-b2ff-de5feb1b9599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c463ab73-4733-4003-af00-2f60b03384ee tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Created volume successfully. Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:50 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba Sep 25 10:53:50 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:50 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f Sep 25 10:53:50 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:50 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f" returned: 0 in 0.296s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.559s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2054975726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93436e20-5945-4baf-bd80-b24ea1160755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:45Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Creating volume 93436e20-5945-4baf-bd80-b24ea1160755 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:50 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-2cbbd5ce-da9d-4805-a929-6655de22012e-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:50 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755 1073741824 Sep 25 10:53:50 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c463245a-862b-4ac6-b663-2eb8ea2d6d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf544db-3c76-42d9-bdc3-0876d20f849f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384672b9-a4f3-4f23-b79b-c58f26e76fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-2cbbd5ce-da9d-4805-a929-6655de22012e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:50 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume volume-faf544db-3c76-42d9-bdc3-0876d20f849f (faf544db-3c76-42d9-bdc3-0876d20f849f): created successfully Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384672b9-a4f3-4f23-b79b-c58f26e76fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:50 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (a9e202e8-b699-4103-bfe2-14c870dccf1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba" returned: 0 in 0.543s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:53:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1c8ca58b-c523-4481-a284-497988da106d tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created volume successfully. Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4686a92e-81b2-479a-a8d3-ef1046336cc5]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-quobyte-2cbbd5ce-da9d-4805-a929-6655de22012e" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-2cbbd5ce-da9d-4805-a929-6655de22012e" acquired by "delete_volume" :: waited 0.046s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cf3063-478e-4172-8914-534506682e08]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:50 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a Sep 25 10:53:50 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Acquiring lock "cinder-d516b477-7d0f-46b8-a799-2f484383ebf6-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Lock "cinder-d516b477-7d0f-46b8-a799-2f484383ebf6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:51 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e Sep 25 10:53:51 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Acquiring lock "cinder-quobyte-d516b477-7d0f-46b8-a799-2f484383ebf6" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Lock "cinder-quobyte-d516b477-7d0f-46b8-a799-2f484383ebf6" acquired by "delete_volume" :: waited 0.041s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d04f2d-6bb3-4bf6-ba19-e2f3bfb29266]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:51 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755 1073741824" returned: 0 in 0.853s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:51 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 Sep 25 10:53:51 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:51 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" returned: 0 in 0.759s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:51 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755 Sep 25 10:53:51 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:51 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba Sep 25 10:53:51 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:51 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e" returned: 0 in 0.712s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:51 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e Sep 25 10:53:51 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:51 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755" returned: 0 in 0.353s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.390s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664755308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31feaba8-323c-4ab9-af3c-396e2dcaa596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:45Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Creating volume 31feaba8-323c-4ab9-af3c-396e2dcaa596 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:51 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:51 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6" returned: 0 in 0.599s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:51 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596 1073741824 Sep 25 10:53:51 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ea2c09-6a10-4892-9056-440417ee5db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93436e20-5945-4baf-bd80-b24ea1160755', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:51 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6 Sep 25 10:53:51 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91298aeb-1e18-4d35-8445-2333cc6ad261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:51 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume volume-93436e20-5945-4baf-bd80-b24ea1160755 (93436e20-5945-4baf-bd80-b24ea1160755): created successfully Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91298aeb-1e18-4d35-8445-2333cc6ad261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (16b8ed17-8e7f-414c-b6d5-080566b4b79b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:51 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ed9cb0b5-f847-4fd9-b258-76eb27f608cd tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created volume successfully. Sep 25 10:53:51 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2cbbd5ce-da9d-4805-a929-6655de22012e" returned: 0 in 0.412s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-2cbbd5ce-da9d-4805-a929-6655de22012e" released by "delete_volume" :: held 1.229s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:52 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba" returned: 0 in 0.574s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created reservations ['a54468d7-01c7-4918-be56-bade57c6913a', 'e98b1afd-4adc-44f2-b0ea-d3c5597dac35', 'b0cfaeb1-a1bc-4421-82bc-0f5c644cca83', 'a549618d-54d5-47eb-8255-7adada759895'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:52 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba Sep 25 10:53:52 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:52 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-d516b477-7d0f-46b8-a799-2f484383ebf6" returned: 0 in 0.434s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:52 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:52 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Lock "cinder-quobyte-d516b477-7d0f-46b8-a799-2f484383ebf6" released by "delete_volume" :: held 1.114s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Created reservations ['0cd3b69f-a1ee-4ce5-8b2a-e4b87ee9add7', 'de53d965-9bbc-4fcc-b470-078e84e0745c', 'd9f32ad3-3963-4909-bae8-6e7b8442efb3', 'd9bb10d1-4a62-48aa-8039-a1459a997b84'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:52 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a.cb8e3f83-e9b1-4214-9ddd-268959ad2dba" returned: 0 in 0.492s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:52 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:52 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Lock "cinder-quobyte-cb8e3f83-e9b1-4214-9ddd-268959ad2dba" released by "_delete_snapshot" :: held 2.565s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:52 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Lock "cinder-quobyte-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" released by "delete_snapshot" :: held 2.614s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596 1073741824" returned: 0 in 0.812s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:52 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.439s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:52 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Deleted volume successfully. Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Created reservations ['1682f8d0-fcbe-4149-bc8f-638d91a080f4', 'c29efed9-dabf-4cf4-be43-86cb351bfd83', 'a77edb00-d35e-4cda-a461-b4fc799b3a37', 'fa6bcdfa-3c8a-4dc7-8e38-75efbcce1884'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ddb392d6-997b-4444-87cd-cd50b23c30cf tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-2cbbd5ce-da9d-4805-a929-6655de22012e-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:52 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.340s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:52 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596 Sep 25 10:53:52 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:52 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:52 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Deleted volume successfully. Sep 25 10:53:53 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596" returned: 0 in 0.307s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.063s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1607584022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:46Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Creating volume aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:53 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32620f36-f501-4d22-9806-5a957c6201e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31feaba8-323c-4ab9-af3c-396e2dcaa596', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59eff698-2119-42bf-90c0-38f7b3f97963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:53 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 1073741824 Sep 25 10:53:53 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:53 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume volume-31feaba8-323c-4ab9-af3c-396e2dcaa596 (31feaba8-323c-4ab9-af3c-396e2dcaa596): created successfully Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59eff698-2119-42bf-90c0-38f7b3f97963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (c6494832-3369-496d-ab88-8d4cd257fe6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-f91a2493-4116-4abd-af73-918e50884b5a-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ed5f0908-2070-4fa3-8b22-bbbaedaa7728 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created volume successfully. Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-ffb126f6-8b1e-4d2d-aa07-ee053114d83a tempest-VolumeAndVolumeTypeFromImageTest-269181046 None] Lock "cinder-d516b477-7d0f-46b8-a799-2f484383ebf6-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Delete snapshot completed successfully. Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-454c0838-a4d0-48c2-a7db-09d7e4418cfc tempest-CinderUnicodeTest-686043498 None] Lock "cinder-cb8e3f83-e9b1-4214-9ddd-268959ad2dba-delete_snapshot" released by "delete_snapshot" :: held 3.365s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-f91a2493-4116-4abd-af73-918e50884b5a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-quobyte-f91a2493-4116-4abd-af73-918e50884b5a" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-f91a2493-4116-4abd-af73-918e50884b5a" acquired by "delete_volume" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e9086-293a-4627-8088-014bf89fcec4]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:53 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a Sep 25 10:53:53 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:53 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 1073741824" returned: 0 in 0.776s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:53 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 Sep 25 10:53:53 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:54 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a" returned: 0 in 0.548s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:54 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a Sep 25 10:53:54 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:54 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Acquiring lock "cinder-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28" returned: 0 in 0.408s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.663s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1066558109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f43f55-9cbd-4358-bada-3dd80a7cd98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dca3dbbd4bc426e8d7205b52824d7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:53:47Z,use_quota=True,user_id='386c02f7e81a4d4fb4c26899129a10c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Creating volume f2f43f55-9cbd-4358-bada-3dd80a7cd98c {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:53:54 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567c63db-f4d0-4a84-8825-9a9db195fb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:54 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c 1073741824 Sep 25 10:53:54 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c89ff4-ab2d-4c66-82ba-7108ba9e7ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Lock "cinder-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:54 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 (aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28): created successfully Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c89ff4-ab2d-4c66-82ba-7108ba9e7ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (82bb6506-b757-4791-b1c6-0ecb033b38a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:54 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:54 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-017c3e23-967d-41f8-ae56-a8df9dec6d12 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created volume successfully. Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f91a2493-4116-4abd-af73-918e50884b5a" returned: 0 in 0.509s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Acquiring lock "cinder-quobyte-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-f91a2493-4116-4abd-af73-918e50884b5a" released by "delete_volume" :: held 1.165s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Lock "cinder-quobyte-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" acquired by "delete_volume" :: waited 0.052s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0c3262-7219-4aa1-b004-20a0c6bfadaf]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:54 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created reservations ['473acce6-ddad-44cd-a518-0243012708c4', 'af6938c4-c382-4d03-95b1-8af38d46bb9c', '3bb6233c-b2d1-4b2f-bc6a-9306939b8e96', 'd9f4e424-bcf0-4470-bf20-cb3e1632f863'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:54 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a Sep 25 10:53:54 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:55 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:55 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:55 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c 1073741824" returned: 0 in 0.836s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:55 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c Sep 25 10:53:55 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:55 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" returned: 0 in 0.616s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:55 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a Sep 25 10:53:55 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:55 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.490s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:55 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Deleted volume successfully. Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd0d35f-89ec-406a-8acd-8c3be0dadafd tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-f91a2493-4116-4abd-af73-918e50884b5a-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:55 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" returned: 0 in 0.330s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:55 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c" returned: 0 in 0.438s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Lock "cinder-quobyte-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a" released by "delete_volume" :: held 1.107s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-00ce0a2b-217c-40c1-ac82-dff73b1e5e09-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2857b01-6c30-48cb-9674-fdfb92dcbf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07fc73b-36fe-4459-adec-3d046090a748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-00ce0a2b-217c-40c1-ac82-dff73b1e5e09-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:55 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Volume volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c (f2f43f55-9cbd-4358-bada-3dd80a7cd98c): created successfully Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07fc73b-36fe-4459-adec-3d046090a748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Flow 'volume_create_manager' (5dfcf710-dcbf-422d-bc8f-a312e0c0cbde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:53:55 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-29b9bdc4-add0-4370-a928-70ed36b26a1b tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created volume successfully. Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-quobyte-00ce0a2b-217c-40c1-ac82-dff73b1e5e09" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Created reservations ['a049becc-62e5-45ca-9f46-def55dba1cfc', 'e2e0075f-01fb-4008-9ad1-ab9bf8b32457', '15dca512-550d-4f41-982a-7970392950e2', 'ee4b06b6-dfe0-41c2-b21b-f902534416b7'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-00ce0a2b-217c-40c1-ac82-dff73b1e5e09" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e18141-7317-4ede-8323-cc07cdbcf45f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:56 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:56 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:56 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09 Sep 25 10:53:56 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:56 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.395s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:56 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Deleted volume successfully. Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-70c4c421-8ef3-422e-93e3-9b1e510eef81 tempest-CinderUnicodeTest-686043498 None] Lock "cinder-bb6125cb-a6ba-4d80-9bfa-e7c610d3d09a-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:56 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09" returned: 0 in 0.579s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:56 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09 Sep 25 10:53:56 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Acquiring lock "cinder-9d4ce290-76d3-4797-b72b-6436a3c69d2e-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Lock "cinder-9d4ce290-76d3-4797-b72b-6436a3c69d2e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Acquiring lock "cinder-quobyte-9d4ce290-76d3-4797-b72b-6436a3c69d2e" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Lock "cinder-quobyte-9d4ce290-76d3-4797-b72b-6436a3c69d2e" acquired by "delete_volume" :: waited 0.038s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8d540e-18b3-4f35-ae66-fb6fe03fc90c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:57 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-00ce0a2b-217c-40c1-ac82-dff73b1e5e09" returned: 0 in 0.454s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-00ce0a2b-217c-40c1-ac82-dff73b1e5e09" released by "delete_volume" :: held 1.113s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:57 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e Sep 25 10:53:57 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-f2f43f55-9cbd-4358-bada-3dd80a7cd98c-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created reservations ['6d3bff0e-aede-456b-bb3d-990eee4c5ff4', '648a1129-55c6-48da-9841-4196a2006ff1', 'bdfa911e-80af-4034-8315-7d3b47709d37', '34770b57-063b-4599-a5d0-8c9a74076e7f'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-f2f43f55-9cbd-4358-bada-3dd80a7cd98c-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-quobyte-f2f43f55-9cbd-4358-bada-3dd80a7cd98c" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-f2f43f55-9cbd-4358-bada-3dd80a7cd98c" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d555dd-95d1-4b80-a5c2-fc62827de226]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:57 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:57 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:57 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e" returned: 0 in 0.527s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:57 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e Sep 25 10:53:57 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:57 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c Sep 25 10:53:57 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:57 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.473s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:57 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Deleted volume successfully. Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a1a4e97a-e878-4a90-892b-191da4722949 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-00ce0a2b-217c-40c1-ac82-dff73b1e5e09-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:57 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9d4ce290-76d3-4797-b72b-6436a3c69d2e" returned: 0 in 0.471s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Lock "cinder-quobyte-9d4ce290-76d3-4797-b72b-6436a3c69d2e" released by "delete_volume" :: held 1.090s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Created reservations ['e88e6f35-248b-4219-8e7b-81cf42db2a72', '568a3c16-3709-47d8-998e-46c2b1fd0af5', '42ab19b2-064e-4fc1-9b2d-33c3f49d3683', '6cad51ef-07a2-41f2-962c-63d9fb2af1bb'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-f96525a5-7b6e-4d51-b469-cd60e553227c-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:58 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-f96525a5-7b6e-4d51-b469-cd60e553227c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c" returned: 0 in 0.700s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:58 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c Sep 25 10:53:58 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "cinder-quobyte-f96525a5-7b6e-4d51-b469-cd60e553227c" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-f96525a5-7b6e-4d51-b469-cd60e553227c" acquired by "delete_volume" :: waited 0.048s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:58 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:58 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4855d640-623a-465a-bd87-a432d0bcf142]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:58 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c Sep 25 10:53:58 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:58 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f2f43f55-9cbd-4358-bada-3dd80a7cd98c" returned: 0 in 0.535s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-f2f43f55-9cbd-4358-bada-3dd80a7cd98c" released by "delete_volume" :: held 1.340s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:58 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.491s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Deleted volume successfully. Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-653a279d-63bc-492f-8857-6bf0611761cb tempest-CinderUnicodeTest-686043498 None] Lock "cinder-9d4ce290-76d3-4797-b72b-6436a3c69d2e-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created reservations ['50fe5bad-247a-4496-aeaf-07a3ffdef586', '779d5ce9-feff-4710-b8f1-a700e682a3ac', '2cdcf6ee-cb9f-4e7f-8d90-1b8dd359d29f', 'bc8e9521-7735-47f6-8356-2cbce2cca073'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:58 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c" returned: 0 in 0.626s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:59 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c Sep 25 10:53:59 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:59 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:59 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:59 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f96525a5-7b6e-4d51-b469-cd60e553227c" returned: 0 in 0.390s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-quobyte-f96525a5-7b6e-4d51-b469-cd60e553227c" released by "delete_volume" :: held 1.121s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:59 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.456s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Created reservations ['3dc96bf3-705c-4417-b1e6-ad47f84cd3a0', 'e4fc91ab-9b13-4c95-8e47-f1e4626385e6', '681efa7c-73ca-4ac9-83b5-e6498b879edb', '479c2be3-2168-4f0d-8712-1e32942062f8'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:53:59 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Deleted volume successfully. Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-834c90f0-1663-4351-9ff8-12119888fe8c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-f2f43f55-9cbd-4358-bada-3dd80a7cd98c-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:59 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:53:59 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-quobyte-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09ef804-ce30-45ea-a228-5ba97fe2643d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:53:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:00 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 Sep 25 10:54:00 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:00 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.470s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:00 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:00 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Deleted volume successfully. Sep 25 10:54:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-27c8155e-ea4c-42f3-9edd-7ad739e4a606 tempest-CreateVolumesFromSourceVolumeTest-2140845178 None] Lock "cinder-f96525a5-7b6e-4d51-b469-cd60e553227c-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:00 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28" returned: 0 in 0.590s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:00 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28 Sep 25 10:54:00 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:00 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28" returned: 0 in 0.366s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:00 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28" released by "delete_volume" :: held 1.050s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:01 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created reservations ['ac802871-c0e9-4513-b369-b0c032e7c76c', 'e9bee874-2e17-4254-934e-a0221c31e776', '2bd107f9-4c75-4bfa-adf0-a25dd7536f7f', 'ef96b1f5-c562-44c8-9a23-b23f52abc299'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:01 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:01 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:01 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.388s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:01 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:01 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Deleted volume successfully. Sep 25 10:54:01 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-dfa5ac72-3f31-4df2-ac36-7e2e6cfd6a7c tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-aa2c2596-dc4a-4e1d-8bd1-4466e6f08c28-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Flow 'volume_create_manager' (768a285e-a5cc-434d-80c7-d69ca6ae67f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388f710b-62ad-4289-88bc-18676d1da166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-31feaba8-323c-4ab9-af3c-396e2dcaa596-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388f710b-62ad-4289-88bc-18676d1da166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1175561213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8f28b6-405e-48e0-977b-3a792e251026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6538274867b4ede8955f50a020faf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:02Z,use_quota=True,user_id='bb06b81eb8284da9bf0ea895d07c25f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0af2df-9c33-478c-93ed-2857ddad99ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0af2df-9c33-478c-93ed-2857ddad99ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3df2647-1b9e-4564-8038-97ea704095fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3df2647-1b9e-4564-8038-97ea704095fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b8f28b6-405e-48e0-977b-3a792e251026', 'volume_name': 'volume-9b8f28b6-405e-48e0-977b-3a792e251026', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3552db1-5743-498f-bb6b-822eef32932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3552db1-5743-498f-bb6b-822eef32932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbf1f84-edb7-437e-ae0d-a7773a0bcbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:02 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Volume 9b8f28b6-405e-48e0-977b-3a792e251026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b8f28b6-405e-48e0-977b-3a792e251026', 'volume_size': 1} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1175561213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8f28b6-405e-48e0-977b-3a792e251026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6538274867b4ede8955f50a020faf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:02Z,use_quota=True,user_id='bb06b81eb8284da9bf0ea895d07c25f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Creating volume 9b8f28b6-405e-48e0-977b-3a792e251026 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:02 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-31feaba8-323c-4ab9-af3c-396e2dcaa596-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:02 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026 1073741824 Sep 25 10:54:02 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-quobyte-31feaba8-323c-4ab9-af3c-396e2dcaa596" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-31feaba8-323c-4ab9-af3c-396e2dcaa596" acquired by "delete_volume" :: waited 0.035s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3538f5ec-debb-4df3-96e0-d4405f2122b3]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:03 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596 Sep 25 10:54:03 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Flow 'volume_create_manager' (685adaad-238e-44ab-9770-66a6b54079cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32552fc2-86e7-4a8f-a0b9-1d573f088175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32552fc2-86e7-4a8f-a0b9-1d573f088175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1886287885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb9bb36-f473-48ae-aacb-01a84f2806a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6538274867b4ede8955f50a020faf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:03Z,use_quota=True,user_id='bb06b81eb8284da9bf0ea895d07c25f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df42bb6f-c0fb-41aa-8dbc-a15382481cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df42bb6f-c0fb-41aa-8dbc-a15382481cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b19d9c7-c8c0-4033-9b35-7670b30bcb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b19d9c7-c8c0-4033-9b35-7670b30bcb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb9bb36-f473-48ae-aacb-01a84f2806a5', 'volume_name': 'volume-deb9bb36-f473-48ae-aacb-01a84f2806a5', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c37c198-9c4b-4e94-a80d-20407b8b738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c37c198-9c4b-4e94-a80d-20407b8b738e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1444bf4c-3647-4767-8ff3-65ec338e2529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:03 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Volume deb9bb36-f473-48ae-aacb-01a84f2806a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb9bb36-f473-48ae-aacb-01a84f2806a5', 'volume_size': 1} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:03 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026 1073741824" returned: 0 in 1.081s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:03 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:03 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:03 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596" returned: 0 in 1.036s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:03 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026 Sep 25 10:54:03 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:03 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596 Sep 25 10:54:03 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Flow 'volume_create_manager' (f54bc94c-2899-47dd-96d7-e7b917ce485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16546585-6aea-41b3-9c8f-7a5554ab8f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16546585-6aea-41b3-9c8f-7a5554ab8f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-771886949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed0b69d-df74-4bbe-af5a-86269110683c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6538274867b4ede8955f50a020faf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:04Z,use_quota=True,user_id='bb06b81eb8284da9bf0ea895d07c25f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cebd56-9eb4-40a8-aa8f-f120386aaaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cebd56-9eb4-40a8-aa8f-f120386aaaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be42f3c6-ff71-4ed8-823e-57d52bcb7048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be42f3c6-ff71-4ed8-823e-57d52bcb7048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fed0b69d-df74-4bbe-af5a-86269110683c', 'volume_name': 'volume-fed0b69d-df74-4bbe-af5a-86269110683c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0776427b-312f-4429-91f5-7dec95458d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0776427b-312f-4429-91f5-7dec95458d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa86e17-a493-451c-967b-20938313f2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Volume fed0b69d-df74-4bbe-af5a-86269110683c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fed0b69d-df74-4bbe-af5a-86269110683c', 'volume_size': 1} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:04 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.814s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:54:04 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026" returned: 0 in 0.655s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.094s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1886287885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb9bb36-f473-48ae-aacb-01a84f2806a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6538274867b4ede8955f50a020faf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:03Z,use_quota=True,user_id='bb06b81eb8284da9bf0ea895d07c25f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Creating volume deb9bb36-f473-48ae-aacb-01a84f2806a5 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:04 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbf1f84-edb7-437e-ae0d-a7773a0bcbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b8f28b6-405e-48e0-977b-3a792e251026', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:04 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:04 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5 1073741824 Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6342d48-e88e-42b4-9266-0deb56d501b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-31feaba8-323c-4ab9-af3c-396e2dcaa596" returned: 0 in 0.704s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:04 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Volume volume-9b8f28b6-405e-48e0-977b-3a792e251026 (9b8f28b6-405e-48e0-977b-3a792e251026): created successfully Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6342d48-e88e-42b4-9266-0deb56d501b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Flow 'volume_create_manager' (768a285e-a5cc-434d-80c7-d69ca6ae67f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-31feaba8-323c-4ab9-af3c-396e2dcaa596" released by "delete_volume" :: held 1.859s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c8713580-48d4-4bd3-ad4d-816053e2185e tempest-CreateVolumesFromImageTest-1554291431 None] Created volume successfully. Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created reservations ['d9b8aa94-638f-4da6-9ac9-5ca4c3fa7b9f', '0de8d9c6-7e8f-4e12-a496-b3a9c24b400d', '9393d133-5fe9-4012-8ff6-d81bf503a104', '8a7e6182-e5a4-4417-a104-c2bad52d89be'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Flow 'volume_create_manager' (f1fdce73-d71f-4cea-8715-228205c67f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a583aa0-1e44-48c9-be8a-9ae78e2ebd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a583aa0-1e44-48c9-be8a-9ae78e2ebd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-698114966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff315200-1b50-4f41-bb42-dd4611664844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6538274867b4ede8955f50a020faf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:05Z,use_quota=True,user_id='bb06b81eb8284da9bf0ea895d07c25f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f8e55f-dda6-4253-b53a-fea261cb62b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f8e55f-dda6-4253-b53a-fea261cb62b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13759985-c1d8-40ef-a843-306f9ab35485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13759985-c1d8-40ef-a843-306f9ab35485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff315200-1b50-4f41-bb42-dd4611664844', 'volume_name': 'volume-ff315200-1b50-4f41-bb42-dd4611664844', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019498ae-2d10-406f-afc9-9c0a7e3c389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019498ae-2d10-406f-afc9-9c0a7e3c389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:04 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59fbeda-fc44-4dee-a2d1-2c316bab6952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:04 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Volume ff315200-1b50-4f41-bb42-dd4611664844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff315200-1b50-4f41-bb42-dd4611664844', 'volume_size': 1} Sep 25 10:54:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:04 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-93436e20-5945-4baf-bd80-b24ea1160755-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-93436e20-5945-4baf-bd80-b24ea1160755-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-quobyte-93436e20-5945-4baf-bd80-b24ea1160755" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-93436e20-5945-4baf-bd80-b24ea1160755" acquired by "delete_volume" :: waited 0.060s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c7b53e-7f2a-4be7-89cb-49ff0db60749]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:05 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5 1073741824" returned: 0 in 0.937s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:05 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755 Sep 25 10:54:05 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:05 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5 Sep 25 10:54:05 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:05 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.665s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:05 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Deleted volume successfully. Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Flow 'volume_create_manager' (6b73515d-dd82-437f-a6b2-463a197afe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318216e8-ff02-42eb-9408-12d34eda8480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318216e8-ff02-42eb-9408-12d34eda8480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1830835971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e3a4d8-56cb-49f0-960b-bfba85c8d8a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6538274867b4ede8955f50a020faf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:05Z,use_quota=True,user_id='bb06b81eb8284da9bf0ea895d07c25f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7a7468-43c2-4382-9aee-d35f7c8c0b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7a7468-43c2-4382-9aee-d35f7c8c0b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce97626-cbdb-4bf8-82ca-7595d8ebba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce97626-cbdb-4bf8-82ca-7595d8ebba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e3a4d8-56cb-49f0-960b-bfba85c8d8a7', 'volume_name': 'volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c4370f-6511-40c9-96af-b9d59487c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c4370f-6511-40c9-96af-b9d59487c37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e854923-10b9-46d8-b8a5-d403ff3ba7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:05 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Volume 73e3a4d8-56cb-49f0-960b-bfba85c8d8a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7', 'volume_size': 1} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b81cc12a-b665-4ba5-9f72-351c72cc2794 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-31feaba8-323c-4ab9-af3c-396e2dcaa596-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:05 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:05 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755" returned: 0 in 0.662s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5" returned: 0 in 0.472s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-771886949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed0b69d-df74-4bbe-af5a-86269110683c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6538274867b4ede8955f50a020faf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:04Z,use_quota=True,user_id='bb06b81eb8284da9bf0ea895d07c25f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Creating volume fed0b69d-df74-4bbe-af5a-86269110683c {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:05 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755 Sep 25 10:54:05 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:05 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1444bf4c-3647-4767-8ff3-65ec338e2529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb9bb36-f473-48ae-aacb-01a84f2806a5', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:06 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c 1073741824 Sep 25 10:54:06 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c1429-9e5a-47be-b606-c92d4b13e991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:06 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Volume volume-deb9bb36-f473-48ae-aacb-01a84f2806a5 (deb9bb36-f473-48ae-aacb-01a84f2806a5): created successfully Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c1429-9e5a-47be-b606-c92d4b13e991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Flow 'volume_create_manager' (685adaad-238e-44ab-9770-66a6b54079cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:06 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f04a199f-eb98-4365-992f-f7127f3464a5 tempest-CreateVolumesFromImageTest-1554291431 None] Created volume successfully. Sep 25 10:54:06 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-93436e20-5945-4baf-bd80-b24ea1160755" returned: 0 in 0.527s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-93436e20-5945-4baf-bd80-b24ea1160755" released by "delete_volume" :: held 1.293s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created reservations ['a485c35a-4d6c-4dac-a87f-1461e0e05874', 'b2b6ae48-0295-4a10-8315-aaf6bea43cbe', 'beca98a8-ca7f-4809-8416-e6a200b2e362', '4d0c4d51-dfee-479d-abfb-d6b9a631425d'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:06 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:06 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:06 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c 1073741824" returned: 0 in 1.004s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:07 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c Sep 25 10:54:07 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:07 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.470s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Deleted volume successfully. Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-553ead0e-a5de-49bc-9807-13922bd20bf6 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-93436e20-5945-4baf-bd80-b24ea1160755-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:07 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c" returned: 0 in 0.471s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-698114966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff315200-1b50-4f41-bb42-dd4611664844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6538274867b4ede8955f50a020faf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:05Z,use_quota=True,user_id='bb06b81eb8284da9bf0ea895d07c25f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Creating volume ff315200-1b50-4f41-bb42-dd4611664844 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:07 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa86e17-a493-451c-967b-20938313f2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fed0b69d-df74-4bbe-af5a-86269110683c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:07 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844 1073741824 Sep 25 10:54:07 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4c0210-a4dd-4740-8990-4aeb8cff74d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-faf544db-3c76-42d9-bdc3-0876d20f849f-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:07 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Volume volume-fed0b69d-df74-4bbe-af5a-86269110683c (fed0b69d-df74-4bbe-af5a-86269110683c): created successfully Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4c0210-a4dd-4740-8990-4aeb8cff74d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Flow 'volume_create_manager' (f54bc94c-2899-47dd-96d7-e7b917ce485e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-faf544db-3c76-42d9-bdc3-0876d20f849f-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6cc717a9-aefd-4bf8-8b3a-a330bac07509 tempest-CreateVolumesFromImageTest-1554291431 None] Created volume successfully. Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-quobyte-faf544db-3c76-42d9-bdc3-0876d20f849f" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-faf544db-3c76-42d9-bdc3-0876d20f849f" acquired by "delete_volume" :: waited 0.044s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6887dc4-cea5-4898-900d-bc868cc24837]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:08 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f Sep 25 10:54:08 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:08 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844 1073741824" returned: 0 in 0.826s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:08 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f" returned: 0 in 0.521s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:08 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f Sep 25 10:54:08 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:08 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844 Sep 25 10:54:08 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:08 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Flow 'volume_create_manager' (0ec0f39f-81c3-41b1-826f-177700a7e2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:08 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3246374e-57fd-413c-809d-dd9debd75a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844" returned: 0 in 0.456s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-faf544db-3c76-42d9-bdc3-0876d20f849f" returned: 0 in 0.523s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.199s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1830835971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e3a4d8-56cb-49f0-960b-bfba85c8d8a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6538274867b4ede8955f50a020faf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:05Z,use_quota=True,user_id='bb06b81eb8284da9bf0ea895d07c25f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Creating volume 73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:09 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3246374e-57fd-413c-809d-dd9debd75a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1880450141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6e0ba5-8218-45ca-9c68-45a401147088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ce05e803ee4190a1a2fd1b2e4e4bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:09Z,use_quota=True,user_id='265f9ec4429a4382908949dc46d04c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:09 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 1073741824 Sep 25 10:54:09 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0621a1ba-6320-401b-baf4-e15623b5a246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0621a1ba-6320-401b-baf4-e15623b5a246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24444e8d-1932-4418-9488-a90986bda893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24444e8d-1932-4418-9488-a90986bda893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6e0ba5-8218-45ca-9c68-45a401147088', 'volume_name': 'volume-1e6e0ba5-8218-45ca-9c68-45a401147088', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2337d1c9-cf35-4384-8a3c-5d5c0a88ed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2337d1c9-cf35-4384-8a3c-5d5c0a88ed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b1bdc0-6aa0-487b-af36-6cccbbfcc78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:09 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Volume 1e6e0ba5-8218-45ca-9c68-45a401147088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6e0ba5-8218-45ca-9c68-45a401147088', 'volume_size': 1} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-faf544db-3c76-42d9-bdc3-0876d20f849f" released by "delete_volume" :: held 1.259s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59fbeda-fc44-4dee-a2d1-2c316bab6952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff315200-1b50-4f41-bb42-dd4611664844', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8050f519-1de5-4549-a3eb-72e0b7eb121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:09 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Volume volume-ff315200-1b50-4f41-bb42-dd4611664844 (ff315200-1b50-4f41-bb42-dd4611664844): created successfully Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8050f519-1de5-4549-a3eb-72e0b7eb121b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Flow 'volume_create_manager' (f1fdce73-d71f-4cea-8715-228205c67f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b08b1103-a42d-40e9-abb4-e261375a8578 tempest-CreateVolumesFromImageTest-1554291431 None] Created volume successfully. Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created reservations ['d34f5917-bf85-467a-b022-ceac741a608d', 'd12c3b62-c3c3-4eab-8353-a85a628e40cf', '2d3f429f-fb67-4f5a-910d-ac08c628a6da', 'dfb64ed1-aa73-4ca6-bfc6-b892c9dc0e0e'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:09 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:09 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:09 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 1073741824" returned: 0 in 0.651s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:09 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 Sep 25 10:54:09 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:09 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.450s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Deleted volume successfully. Sep 25 10:54:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-77ba1101-c18d-4ce3-a1e9-e067845aa486 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-faf544db-3c76-42d9-bdc3-0876d20f849f-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:10 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-6e6c6895-497f-43cc-be9b-db14b8f69dfe-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7" returned: 0 in 0.394s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1880450141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6e0ba5-8218-45ca-9c68-45a401147088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ce05e803ee4190a1a2fd1b2e4e4bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:09Z,use_quota=True,user_id='265f9ec4429a4382908949dc46d04c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Creating volume 1e6e0ba5-8218-45ca-9c68-45a401147088 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:10 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:10 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 1073741824 Sep 25 10:54:10 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e854923-10b9-46d8-b8a5-d403ff3ba7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f4a758-e8ca-4d69-8fe8-a7d92203a873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-6e6c6895-497f-43cc-be9b-db14b8f69dfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-quobyte-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:10 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Volume volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 (73e3a4d8-56cb-49f0-960b-bfba85c8d8a7): created successfully Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f4a758-e8ca-4d69-8fe8-a7d92203a873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Flow 'volume_create_manager' (6b73515d-dd82-437f-a6b2-463a197afe6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-quobyte-6e6c6895-497f-43cc-be9b-db14b8f69dfe" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:10 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8702b81b-c9f5-4b1f-bdbc-1ab8694ec2e9 tempest-CreateVolumesFromImageTest-1554291431 None] Created volume successfully. Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-6e6c6895-497f-43cc-be9b-db14b8f69dfe" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Deleting offline snapshot 6e6c6895-497f-43cc-be9b-db14b8f69dfe of volume a5eeeb17-1d26-4656-9d07-b811fc2c38b7 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] snapshot_file for this snap is: volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[85653479-5136-40da-9b3a-3e037e5fa03c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:10 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe Sep 25 10:54:10 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:10 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 1073741824" returned: 0 in 0.625s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:10 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 Sep 25 10:54:10 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:10 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe" returned: 0 in 0.615s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8426cd-060c-453c-8658-e8ffc730b743]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:11 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 Sep 25 10:54:11 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:11 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088" returned: 0 in 0.472s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b1bdc0-6aa0-487b-af36-6cccbbfcc78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6e0ba5-8218-45ca-9c68-45a401147088', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5bb2b9-acc3-4427-b416-d819d79e90e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:11 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Volume volume-1e6e0ba5-8218-45ca-9c68-45a401147088 (1e6e0ba5-8218-45ca-9c68-45a401147088): created successfully Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5bb2b9-acc3-4427-b416-d819d79e90e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Flow 'volume_create_manager' (0ec0f39f-81c3-41b1-826f-177700a7e2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c0349d17-c69b-4c88-96a6-b83f2b3a3c68 tempest-VolumeDependencyTests-1716573902 None] Created volume successfully. Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "cinder-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "cinder-quobyte-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-quobyte-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3a17bb-66ab-4e08-9fb9-df5183bea89f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:11 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" returned: 0 in 0.679s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:11 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe Sep 25 10:54:11 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:11 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 Sep 25 10:54:11 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:12 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7" returned: 0 in 0.752s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:12 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7 Sep 25 10:54:12 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:12 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe" returned: 0 in 0.787s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:12 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe Sep 25 10:54:12 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Creating offline snapshot 617af030-5bee-43c0-bd70-ca73d8d283bc of volume 1e6e0ba5-8218-45ca-9c68-45a401147088 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[691d4fe4-439e-44e5-86dc-9b92310e0f6c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:12 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7" returned: 0 in 0.381s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-quobyte-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7" released by "delete_volume" :: held 1.214s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:12 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7.6e6c6895-497f-43cc-be9b-db14b8f69dfe" returned: 0 in 0.405s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:12 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 Sep 25 10:54:12 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Created reservations ['f4241a40-aa2c-4af0-a3a1-ccaf0d3b9fd6', '67d05475-af6c-40fe-839f-2b8c204b99d4', '0dfe8700-111f-4d1b-963c-267ba4e9903a', 'b7e21cb8-5251-4429-9685-ae27e5d5491c'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-6e6c6895-497f-43cc-be9b-db14b8f69dfe" released by "_delete_snapshot" :: held 2.694s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:12 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" released by "delete_snapshot" :: held 2.736s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:13 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:13 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created reservations ['8f4b1edf-5347-43d1-b34a-669ff1e6b98c', 'c006498f-ddd1-4e8b-a714-db257db28719', '44f49bee-3170-4fdc-8268-08eadf934f4c', '749b34e4-83dc-484b-bd80-4937908ad634'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:13 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088" returned: 0 in 0.611s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:13 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc 1G Sep 25 10:54:13 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:13 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Delete snapshot completed successfully. Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a3ed54c4-2121-4fa8-90b2-e7a5d7f838d0 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-6e6c6895-497f-43cc-be9b-db14b8f69dfe-delete_snapshot" released by "delete_snapshot" :: held 3.302s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:13 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.438s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:13 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Deleted volume successfully. Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f2bb5aeb-d4c2-40f3-96b3-4cbadd6ae0a3 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-73e3a4d8-56cb-49f0-960b-bfba85c8d8a7-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "cinder-ff315200-1b50-4f41-bb42-dd4611664844-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-ff315200-1b50-4f41-bb42-dd4611664844-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "cinder-quobyte-ff315200-1b50-4f41-bb42-dd4611664844" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:14 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc 1G" returned: 0 in 0.754s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e6e0ba5-8218-45ca-9c68-45a401147088 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-quobyte-ff315200-1b50-4f41-bb42-dd4611664844" acquired by "delete_volume" :: waited 0.042s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:14 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e6e0ba5-8218-45ca-9c68-45a401147088 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc Sep 25 10:54:14 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5f6e41-b019-4aa7-9192-e9364d335f6c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:14 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844 Sep 25 10:54:14 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-a5eeeb17-1d26-4656-9d07-b811fc2c38b7-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-a5eeeb17-1d26-4656-9d07-b811fc2c38b7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "cinder-quobyte-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:14 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e6e0ba5-8218-45ca-9c68-45a401147088 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc" returned: 0 in 0.572s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:14 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc is being set with open permissions: ugo+rw Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e91e93a-049e-4fcf-8baf-a206152f494f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:14 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc Sep 25 10:54:14 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:14 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844" returned: 0 in 0.587s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:14 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844 Sep 25 10:54:14 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:14 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 Sep 25 10:54:14 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:15 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc" returned: 0 in 0.446s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:15 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.info Sep 25 10:54:15 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:15 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-ff315200-1b50-4f41-bb42-dd4611664844" returned: 0 in 0.517s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-quobyte-ff315200-1b50-4f41-bb42-dd4611664844" released by "delete_volume" :: held 1.168s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:15 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" returned: 0 in 0.679s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Created reservations ['3d558348-9a30-48f0-9a49-10bb6206ba46', 'cfe077e7-7d87-4638-b71c-aac3e3d0f0c1', '47442ce2-be8b-446e-89c9-42c39a9389d9', 'e90406e3-47bf-4173-8a32-f2e4835da783'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:15 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7 Sep 25 10:54:15 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:15 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:15 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:15 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.info" returned: 0 in 0.342s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:15 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.info is being set with open permissions: ugo+rw Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:15 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.info Sep 25 10:54:15 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:15 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" returned: 0 in 0.340s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-quobyte-a5eeeb17-1d26-4656-9d07-b811fc2c38b7" released by "delete_volume" :: held 1.132s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Created reservations ['8cf598b2-1b64-443d-b408-8e5ef4a20808', '1ff99c7a-229e-4b17-a7c0-7911bb93edca', '618854b7-5edf-4225-9f58-4fb3364fb7d2', '56ea6059-7a49-4cb1-b593-b007afb75cc0'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:15 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.312s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:15 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Deleted volume successfully. Sep 25 10:54:15 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.info" returned: 0 in 0.296s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.238s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-a27fd448-03d4-4071-928e-2bf2b9233110 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-ff315200-1b50-4f41-bb42-dd4611664844-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:15 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-22f58d6f-a755-4b7e-8d1e-659b46396f58 tempest-VolumeDependencyTests-1716573902 None] Create snapshot completed successfully Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:15 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:15 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:16 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.247s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:16 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Deleted volume successfully. Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8e4d77f7-0aab-4ea0-88f2-9c5d8dbf76d9 tempest-CreateVolumesFromSnapshotTest-1750428335 None] Lock "cinder-a5eeeb17-1d26-4656-9d07-b811fc2c38b7-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "cinder-fed0b69d-df74-4bbe-af5a-86269110683c-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-fed0b69d-df74-4bbe-af5a-86269110683c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "cinder-quobyte-fed0b69d-df74-4bbe-af5a-86269110683c" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-quobyte-fed0b69d-df74-4bbe-af5a-86269110683c" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[939db179-e7fc-432f-ae5f-24c555e30120]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:16 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c Sep 25 10:54:16 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:16 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c" returned: 0 in 0.506s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:16 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c Sep 25 10:54:16 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:17 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-fed0b69d-df74-4bbe-af5a-86269110683c" returned: 0 in 0.358s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-quobyte-fed0b69d-df74-4bbe-af5a-86269110683c" released by "delete_volume" :: held 0.929s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:17 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Created reservations ['70ef2332-5754-488a-8a16-a384259f3ad7', '9d4312fb-389a-4b19-aec0-712417360f16', '8e4d7c2e-08d2-476e-a539-733cd3fd19ec', 'ef41f324-03d9-4dda-9e60-83b3151b0103'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:17 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:17 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:18 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.480s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Deleted volume successfully. Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71951459-2e30-4e72-b996-b9caa77c0d4a tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-fed0b69d-df74-4bbe-af5a-86269110683c-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Flow 'volume_create_manager' (046dbbdc-24a2-4236-afa2-1bf626ecd1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7f9b56-9f9d-49cf-ad8f-56ebe6cc9c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7f9b56-9f9d-49cf-ad8f-56ebe6cc9c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-481127449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ec32ae-fe73-440e-9cf0-82bd04e1cc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ce05e803ee4190a1a2fd1b2e4e4bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=617af030-5bee-43c0-bd70-ca73d8d283bc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:18Z,use_quota=True,user_id='265f9ec4429a4382908949dc46d04c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8166fe0a-8b3b-4513-bd45-73b4b3625d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8166fe0a-8b3b-4513-bd45-73b4b3625d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57dfc01-9ec1-49a6-9fad-1d379c7b1bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57dfc01-9ec1-49a6-9fad-1d379c7b1bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '97ec32ae-fe73-440e-9cf0-82bd04e1cc86', 'volume_name': 'volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86', 'volume_size': 1, 'snapshot_id': '617af030-5bee-43c0-bd70-ca73d8d283bc'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ea6806-b1bf-42da-bca4-72c490dbedc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ea6806-b1bf-42da-bca4-72c490dbedc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f592bd2-98a1-4d46-967e-735c1f9359ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:18 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Volume 97ec32ae-fe73-440e-9cf0-82bd04e1cc86: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86', 'volume_size': 1, 'snapshot_id': '617af030-5bee-43c0-bd70-ca73d8d283bc'} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "cinder-quobyte-617af030-5bee-43c0-bd70-ca73d8d283bc-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" by "_create_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-617af030-5bee-43c0-bd70-ca73d8d283bc-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Creating volume 97ec32ae-fe73-440e-9cf0-82bd04e1cc86 from snapshot 617af030-5bee-43c0-bd70-ca73d8d283bc {{(pid=87242) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "cinder-quobyte-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] snapshot: 617af030-5bee-43c0-bd70-ca73d8d283bc, volume: 97ec32ae-fe73-440e-9cf0-82bd04e1cc86, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec07e6e0-f954-43a6-8227-1ebc0f893dd1]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "cinder-deb9bb36-f473-48ae-aacb-01a84f2806a5-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-deb9bb36-f473-48ae-aacb-01a84f2806a5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "cinder-quobyte-deb9bb36-f473-48ae-aacb-01a84f2806a5" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-quobyte-deb9bb36-f473-48ae-aacb-01a84f2806a5" acquired by "delete_volume" :: waited 0.053s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:18 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc Sep 25 10:54:18 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e684dd70-d8df-4c56-97b6-cbc3af8171a5]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:19 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5 Sep 25 10:54:19 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:19 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5" returned: 0 in 0.501s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:19 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc" returned: 0 in 0.768s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:19 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e6e0ba5-8218-45ca-9c68-45a401147088(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:54:19 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3745dd4c-ccfa-4553-878b-fdca482e0092]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:19 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5 Sep 25 10:54:19 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:19 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 Sep 25 10:54:19 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:19 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-deb9bb36-f473-48ae-aacb-01a84f2806a5" returned: 0 in 0.502s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:19 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-quobyte-deb9bb36-f473-48ae-aacb-01a84f2806a5" released by "delete_volume" :: held 1.098s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Created reservations ['65dc92d7-deed-45b9-ad56-aad1d46701b2', '55c7dc8d-9e64-4743-a8ef-0c4713797550', 'b5a5e7a0-d0aa-4294-8f63-b3db0278eb9f', '68910c8f-b88a-4dcb-a940-ae2047073477'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:20 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088" returned: 0 in 0.683s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:20 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 Sep 25 10:54:20 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:20 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:20 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:20 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.415s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Deleted volume successfully. Sep 25 10:54:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2630f315-a430-4b2e-b24d-e35ccdaf94b9 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-deb9bb36-f473-48ae-aacb-01a84f2806a5-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "cinder-9b8f28b6-405e-48e0-977b-3a792e251026-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-9b8f28b6-405e-48e0-977b-3a792e251026-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "cinder-quobyte-9b8f28b6-405e-48e0-977b-3a792e251026" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-quobyte-9b8f28b6-405e-48e0-977b-3a792e251026" acquired by "delete_volume" :: waited 0.082s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:21 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a0f5c8-6eb1-4f01-9e55-2789fb21b41a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:21 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026 Sep 25 10:54:21 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:22 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026" returned: 0 in 1.034s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:22 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026 Sep 25 10:54:22 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:23 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9b8f28b6-405e-48e0-977b-3a792e251026" returned: 0 in 0.827s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-quobyte-9b8f28b6-405e-48e0-977b-3a792e251026" released by "delete_volume" :: held 2.000s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (7f4a81ca-bc28-4a2a-930a-2744ebd62bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1694eaff-6610-49f8-a762-60191409c7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Created reservations ['458a28cc-3199-4084-bf78-1c3a6c8db3ba', '37e08ce3-fdd2-4933-8fec-d8f1b0f71f5d', '5207d49a-6095-401d-8bbf-53193cec2158', '740911b4-c3e3-4e2b-8e05-a28a888ebcd3'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1694eaff-6610-49f8-a762-60191409c7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942619623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531486d3-c2ea-4618-bc0c-ab9988832f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:24Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4a574d-2813-4c83-84cf-2786ff770756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4a574d-2813-4c83-84cf-2786ff770756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b35a9db-6c18-4aed-9ae7-6e598f697895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b35a9db-6c18-4aed-9ae7-6e598f697895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531486d3-c2ea-4618-bc0c-ab9988832f3c', 'volume_name': 'volume-531486d3-c2ea-4618-bc0c-ab9988832f3c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e87fae-d80f-40fa-ab14-d14f593db8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e87fae-d80f-40fa-ab14-d14f593db8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49a2418-3d3f-4d4a-b58c-554c9a51822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:23 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Volume 531486d3-c2ea-4618-bc0c-ab9988832f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531486d3-c2ea-4618-bc0c-ab9988832f3c', 'volume_size': 1} Sep 25 10:54:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:24 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:24 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:24 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.442s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:24 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:24 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Deleted volume successfully. Sep 25 10:54:24 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7b44ee73-ce65-4bf9-8478-ebd7c45262e7 tempest-CreateVolumesFromImageTest-1554291431 None] Lock "cinder-9b8f28b6-405e-48e0-977b-3a792e251026-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:29 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" returned: 0 in 9.415s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:29 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088, size 1024.00 MB, duration 9.42 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:54:29 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Converted 1024.00 MB image at 108.75 MB/s Sep 25 10:54:29 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 is being set with open permissions: ugo+rw Sep 25 10:54:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:29 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 Sep 25 10:54:29 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:29 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" returned: 0 in 0.338s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" released by "_copy_volume_from_snapshot" :: held 11.359s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:29 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=185,cinder:UPDATE=230,cinder:INSERT=66,cinder:DELETE=24 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:54:29 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=253,cinder:SELECT=161,cinder:INSERT=56,cinder:DELETE=20 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-617af030-5bee-43c0-bd70-ca73d8d283bc-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" released by "_create_volume_from_snapshot" :: held 11.459s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.481s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.119s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942619623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531486d3-c2ea-4618-bc0c-ab9988832f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:24Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Creating volume 531486d3-c2ea-4618-bc0c-ab9988832f3c {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:30 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:30 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c 1073741824 Sep 25 10:54:30 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f592bd2-98a1-4d46-967e-735c1f9359ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86', 'volume_size': 1, 'snapshot_id': '617af030-5bee-43c0-bd70-ca73d8d283bc'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9929ad7-609a-4028-9097-f7152b57a3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:30 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Volume volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 (97ec32ae-fe73-440e-9cf0-82bd04e1cc86): created successfully Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9929ad7-609a-4028-9097-f7152b57a3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Flow 'volume_create_manager' (046dbbdc-24a2-4236-afa2-1bf626ecd1bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-302ed794-8a83-4d23-949e-fc55ea5453b8 tempest-VolumeDependencyTests-1716573902 None] Created volume successfully. Sep 25 10:54:30 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c 1073741824" returned: 0 in 0.600s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "cinder-617af030-5bee-43c0-bd70-ca73d8d283bc-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:30 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c Sep 25 10:54:30 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-617af030-5bee-43c0-bd70-ca73d8d283bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "cinder-quobyte-1e6e0ba5-8218-45ca-9c68-45a401147088" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-1e6e0ba5-8218-45ca-9c68-45a401147088" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "cinder-quobyte-617af030-5bee-43c0-bd70-ca73d8d283bc" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-617af030-5bee-43c0-bd70-ca73d8d283bc" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Deleting offline snapshot 617af030-5bee-43c0-bd70-ca73d8d283bc of volume 1e6e0ba5-8218-45ca-9c68-45a401147088 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] snapshot_file for this snap is: volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d7831a-7bfb-4dd2-bd18-9ff2e8883cff]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Flow 'volume_create_manager' (5a31ca7a-383d-424b-97a0-245c5a51b69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f9d54a-d63d-40b0-8e21-b5d5f9ea5488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:31 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc Sep 25 10:54:31 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f9d54a-d63d-40b0-8e21-b5d5f9ea5488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1358444402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69516890-2433-40be-9ca6-8c528a9e4101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1579cd4e254621ab28007f640bef32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:31Z,use_quota=True,user_id='374b495bf8f04494aedfe012f576264d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b935d89f-d2c4-4502-99a1-591b53b6beb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:31 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b935d89f-d2c4-4502-99a1-591b53b6beb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81651dc-ef43-4bb9-a16a-c03936228873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81651dc-ef43-4bb9-a16a-c03936228873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69516890-2433-40be-9ca6-8c528a9e4101', 'volume_name': 'volume-69516890-2433-40be-9ca6-8c528a9e4101', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2f9bb2-0cc4-4963-ac01-ed190b6dd0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2f9bb2-0cc4-4963-ac01-ed190b6dd0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a492c4b-b71b-48e3-9dc5-63dedcb4bb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:31 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Volume 69516890-2433-40be-9ca6-8c528a9e4101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69516890-2433-40be-9ca6-8c528a9e4101', 'volume_size': 1} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c" returned: 0 in 0.413s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1358444402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69516890-2433-40be-9ca6-8c528a9e4101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1579cd4e254621ab28007f640bef32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:31Z,use_quota=True,user_id='374b495bf8f04494aedfe012f576264d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Creating volume 69516890-2433-40be-9ca6-8c528a9e4101 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:31 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49a2418-3d3f-4d4a-b58c-554c9a51822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531486d3-c2ea-4618-bc0c-ab9988832f3c', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:31 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101 1073741824 Sep 25 10:54:31 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede5db60-c0b5-49ac-88ae-30a2c8fde9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:31 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Volume volume-531486d3-c2ea-4618-bc0c-ab9988832f3c (531486d3-c2ea-4618-bc0c-ab9988832f3c): created successfully Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede5db60-c0b5-49ac-88ae-30a2c8fde9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (7f4a81ca-bc28-4a2a-930a-2744ebd62bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:31 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-82510a71-0a2e-484f-abab-da95a4b7cd59 tempest-ProjectMemberTests-1442491369 None] Created volume successfully. Sep 25 10:54:31 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc" returned: 0 in 0.566s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e6e0ba5-8218-45ca-9c68-45a401147088(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[785bbc60-c392-4985-98eb-069c08a27ed7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:31 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 Sep 25 10:54:31 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:31 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101 1073741824" returned: 0 in 0.717s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:32 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101 Sep 25 10:54:32 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:32 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088" returned: 0 in 0.823s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:32 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc Sep 25 10:54:32 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:32 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101" returned: 0 in 0.466s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.222s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Creating offline snapshot e1ef6b19-f6e7-42ba-a05a-9661a415d599 of volume 531486d3-c2ea-4618-bc0c-ab9988832f3c {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a492c4b-b71b-48e3-9dc5-63dedcb4bb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69516890-2433-40be-9ca6-8c528a9e4101', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b831090-e01c-4e08-89bc-7915ec0467c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99ca48f-5800-472a-99f7-4e0f04185530]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:32 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Volume volume-69516890-2433-40be-9ca6-8c528a9e4101 (69516890-2433-40be-9ca6-8c528a9e4101): created successfully Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b831090-e01c-4e08-89bc-7915ec0467c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Flow 'volume_create_manager' (5a31ca7a-383d-424b-97a0-245c5a51b69e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:32 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ccb03ae9-ceb8-4cf5-b022-61c94509cbec tempest-ProjectReaderTests-913968605 None] Created volume successfully. Sep 25 10:54:32 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c Sep 25 10:54:32 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:32 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc" returned: 0 in 0.465s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:32 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc Sep 25 10:54:32 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:32 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c" returned: 0 in 0.477s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:33 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 1G Sep 25 10:54:33 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:33 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088.617af030-5bee-43c0-bd70-ca73d8d283bc" returned: 0 in 0.381s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-617af030-5bee-43c0-bd70-ca73d8d283bc" released by "_delete_snapshot" :: held 2.386s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-1e6e0ba5-8218-45ca-9c68-45a401147088" released by "delete_snapshot" :: held 2.434s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Created reservations ['26be1800-1b47-43c3-b207-2f2542879fbc', '2144ff22-bee8-46fb-8ac1-0aea710709f4', '6545ff64-56b0-4918-b384-191bf504e10c', 'f105072e-0e61-4b61-ace9-a3c8fb95eaad'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Acquiring lock "cinder-69516890-2433-40be-9ca6-8c528a9e4101-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Lock "cinder-69516890-2433-40be-9ca6-8c528a9e4101-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:33 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Delete snapshot completed successfully. Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c9c857cf-34d1-4698-bdff-2a9b65cfeec3 tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-617af030-5bee-43c0-bd70-ca73d8d283bc-delete_snapshot" released by "delete_snapshot" :: held 2.733s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Acquiring lock "cinder-quobyte-69516890-2433-40be-9ca6-8c528a9e4101" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Lock "cinder-quobyte-69516890-2433-40be-9ca6-8c528a9e4101" acquired by "delete_volume" :: waited 0.027s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:33 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 1G" returned: 0 in 0.617s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-531486d3-c2ea-4618-bc0c-ab9988832f3c -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5573d1-fe7e-437d-9a07-15f814377660]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:33 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-531486d3-c2ea-4618-bc0c-ab9988832f3c -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 Sep 25 10:54:33 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:33 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101 Sep 25 10:54:33 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:33 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-531486d3-c2ea-4618-bc0c-ab9988832f3c -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599" returned: 0 in 0.372s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:33 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 is being set with open permissions: ugo+rw Sep 25 10:54:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:34 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 Sep 25 10:54:34 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "cinder-1e6e0ba5-8218-45ca-9c68-45a401147088-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-1e6e0ba5-8218-45ca-9c68-45a401147088-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:34 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101" returned: 0 in 0.486s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:34 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101 Sep 25 10:54:34 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "cinder-quobyte-1e6e0ba5-8218-45ca-9c68-45a401147088" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-1e6e0ba5-8218-45ca-9c68-45a401147088" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c46f9b5-ed37-4551-ba33-0018d73a46b0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:34 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 Sep 25 10:54:34 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:34 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599" returned: 0 in 0.520s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:34 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.info Sep 25 10:54:34 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:34 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-69516890-2433-40be-9ca6-8c528a9e4101" returned: 0 in 0.476s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Lock "cinder-quobyte-69516890-2433-40be-9ca6-8c528a9e4101" released by "delete_volume" :: held 1.030s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Created reservations ['d4a6c93b-3cf0-44e3-bc8a-a4ebe12c36db', '11e56a1e-9a1b-4850-b6c1-547b81d6d04b', 'c3706e35-f871-47e3-8c63-7af32df2e517', '5af57f09-0b95-44be-88ae-6ba9f91d28ce'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Flow 'volume_create_manager' (aec668dd-9df0-4c07-8319-d8df5e855f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b026ab-1782-438c-8cff-7810ce0dfbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b026ab-1782-438c-8cff-7810ce0dfbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5628d00-246e-46be-a246-f7277181fc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d18da3f91b4092ac197a4d0ad1191a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:35Z,use_quota=True,user_id='ff5856bb6a0f46c0b2b31d3565c827e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eacbfc42-b368-4f73-ab71-de14251e3c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eacbfc42-b368-4f73-ab71-de14251e3c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0115dd0-3162-40c5-b248-6d6b670ef142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.image.glance [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Creating Keystone auth plugin from conf {{(pid=87242) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 10:54:34 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088" returned: 0 in 0.566s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:34 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088 Sep 25 10:54:34 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:34 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.info" returned: 0 in 0.410s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:34 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.info is being set with open permissions: ugo+rw Sep 25 10:54:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:34 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:34 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:34 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.info Sep 25 10:54:34 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0115dd0-3162-40c5-b248-6d6b670ef142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5628d00-246e-46be-a246-f7277181fc74', 'volume_name': 'volume-f5628d00-246e-46be-a246-f7277181fc74', 'volume_size': 1, 'image_id': 'cd8b3d33-0489-4552-b18d-09da6ad322da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd8b3d33-0489-4552-b18d-09da6ad322da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '075c115fcb6f18f06a8a60fd8347cfcc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13d18da3f91b4092ac197a4d0ad1191a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '296d0ebc5896aea830402835d29dad18578d5749f33162d3f637f82105d07ea5d46e90f8a0a7a912ffbfd9a775237420d0ff61f47daf5622f06c000546520e97', 'id': 'cd8b3d33-0489-4552-b18d-09da6ad322da', 'created_at': datetime.datetime(2026, 9, 25, 8, 54, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 54, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd8b3d33-0489-4552-b18d-09da6ad322da/file', 'properties': {}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6768400e-70ae-4576-b36c-fd944d359e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6768400e-70ae-4576-b36c-fd944d359e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc56b3a-0213-436c-bf12-a95a55a3004f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:35 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Volume f5628d00-246e-46be-a246-f7277181fc74: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5628d00-246e-46be-a246-f7277181fc74', 'volume_size': 1, 'image_id': 'cd8b3d33-0489-4552-b18d-09da6ad322da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd8b3d33-0489-4552-b18d-09da6ad322da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '075c115fcb6f18f06a8a60fd8347cfcc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13d18da3f91b4092ac197a4d0ad1191a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '296d0ebc5896aea830402835d29dad18578d5749f33162d3f637f82105d07ea5d46e90f8a0a7a912ffbfd9a775237420d0ff61f47daf5622f06c000546520e97', 'id': 'cd8b3d33-0489-4552-b18d-09da6ad322da', 'created_at': datetime.datetime(2026, 9, 25, 8, 54, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 54, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd8b3d33-0489-4552-b18d-09da6ad322da/file', 'properties': {}}, 'image_service': } Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Trying to clone f5628d00-246e-46be-a246-f7277181fc74 from image cd8b3d33-0489-4552-b18d-09da6ad322da at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd8b3d33-0489-4552-b18d-09da6ad322da', 'metadata': {}}]). {{(pid=87242) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 10:54:35 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-1e6e0ba5-8218-45ca-9c68-45a401147088" returned: 0 in 0.313s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-1e6e0ba5-8218-45ca-9c68-45a401147088" released by "delete_volume" :: held 0.988s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:35 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.info" returned: 0 in 0.295s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:35 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.360s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 10:54:35 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Image download 0.00 MB at 0.00 MB/s Sep 25 10:54:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Deleted volume successfully. Sep 25 10:54:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-11ea60b3-f5bd-4daa-a82e-14fb5040bf4a tempest-ProjectMemberTests-1442491369 None] Create snapshot completed successfully Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-35f6387d-9b59-4d22-b056-7bf5b04aa201 tempest-ProjectReaderTests-913968605 None] Lock "cinder-69516890-2433-40be-9ca6-8c528a9e4101-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Created reservations ['fb92b3af-3135-4ca0-b402-8931c0b39838', 'e8f012e7-429b-4332-84db-e78c9b5d3bfa', 'd2a2e967-e001-439c-8c29-d44e178cfed4', 'ee88788f-3019-4ed4-8649-63b1bea70f08'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a68ae7-e363-4f26-a838-4d89bc08eb55]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:35 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:35 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:35 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD Sep 25 10:54:35 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:35 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.266s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Deleted volume successfully. Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4eb5d648-412f-4e67-8ae6-419054e990ca tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-1e6e0ba5-8218-45ca-9c68-45a401147088-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:35 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:35 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD Sep 25 10:54:35 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:36 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Temporary image cd8b3d33-0489-4552-b18d-09da6ad322da is fetched for user ff5856bb6a0f46c0b2b31d3565c827e9. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Flow 'volume_create_manager' (848516c4-91b2-414e-89e4-e4003ddfb33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc66bfdb-972e-44d1-ba18-02062cc4a47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc66bfdb-972e-44d1-ba18-02062cc4a47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447585841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551c5780-9464-4a52-821b-d074938d9966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1579cd4e254621ab28007f640bef32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:36Z,use_quota=True,user_id='374b495bf8f04494aedfe012f576264d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63286ec6-c3fb-43c2-908c-0f8211f6dbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63286ec6-c3fb-43c2-908c-0f8211f6dbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8266001-0123-4559-b73c-d2922ab7f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8266001-0123-4559-b73c-d2922ab7f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551c5780-9464-4a52-821b-d074938d9966', 'volume_name': 'volume-551c5780-9464-4a52-821b-d074938d9966', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08222604-e546-48c2-9eab-1e4c307ac7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08222604-e546-48c2-9eab-1e4c307ac7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483200bf-bf2c-4cb6-b77b-87346322fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:36 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Volume 551c5780-9464-4a52-821b-d074938d9966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551c5780-9464-4a52-821b-d074938d9966', 'volume_size': 1} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447585841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551c5780-9464-4a52-821b-d074938d9966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1579cd4e254621ab28007f640bef32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:36Z,use_quota=True,user_id='374b495bf8f04494aedfe012f576264d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Creating volume 551c5780-9464-4a52-821b-d074938d9966 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:36 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:36 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966 1073741824 Sep 25 10:54:36 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4bf59-aba2-43af-95e7-70d01bf64703]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "cinder-97ec32ae-fe73-440e-9cf0-82bd04e1cc86-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-e1ef6b19-f6e7-42ba-a05a-9661a415d599-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Lock "cinder-e1ef6b19-f6e7-42ba-a05a-9661a415d599-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-531486d3-c2ea-4618-bc0c-ab9988832f3c" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-97ec32ae-fe73-440e-9cf0-82bd04e1cc86-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-531486d3-c2ea-4618-bc0c-ab9988832f3c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-e1ef6b19-f6e7-42ba-a05a-9661a415d599" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:36 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD Sep 25 10:54:36 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-e1ef6b19-f6e7-42ba-a05a-9661a415d599" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Deleting offline snapshot e1ef6b19-f6e7-42ba-a05a-9661a415d599 of volume 531486d3-c2ea-4618-bc0c-ab9988832f3c {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] snapshot_file for this snap is: volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "cinder-quobyte-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[473fd2d5-5cf1-4c8d-b7f4-9fb4703bec66]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ca67f6-373b-4938-842b-0c2630fe71cc]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:36 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 Sep 25 10:54:36 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:36 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:36 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 Sep 25 10:54:36 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:36 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966 1073741824" returned: 0 in 0.629s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:36 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD Sep 25 10:54:36 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:37 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966 Sep 25 10:54:37 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:37 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599" returned: 0 in 0.478s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-531486d3-c2ea-4618-bc0c-ab9988832f3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9812cf3-b8b4-457b-aaa1-e945d03f85c6]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:37 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" returned: 0 in 0.543s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:37 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86 Sep 25 10:54:37 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:37 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:37 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c Sep 25 10:54:37 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:37 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966" returned: 0 in 0.321s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5628d00-246e-46be-a246-f7277181fc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d18da3f91b4092ac197a4d0ad1191a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:35Z,use_quota=True,user_id='ff5856bb6a0f46c0b2b31d3565c827e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Creating volume f5628d00-246e-46be-a246-f7277181fc74 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:37 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483200bf-bf2c-4cb6-b77b-87346322fad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551c5780-9464-4a52-821b-d074938d9966', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2b06fd-814f-49b0-b9ca-686305c2b16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:37 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 1073741824 Sep 25 10:54:37 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:37 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Volume volume-551c5780-9464-4a52-821b-d074938d9966 (551c5780-9464-4a52-821b-d074938d9966): created successfully Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2b06fd-814f-49b0-b9ca-686305c2b16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Flow 'volume_create_manager' (848516c4-91b2-414e-89e4-e4003ddfb33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:37 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c52324fa-4364-46cf-a867-5ca918fb0802 tempest-ProjectReaderTests-913968605 None] Created volume successfully. Sep 25 10:54:37 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" returned: 0 in 0.324s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-quobyte-97ec32ae-fe73-440e-9cf0-82bd04e1cc86" released by "delete_volume" :: held 0.952s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Created reservations ['a1281da8-3583-49c4-ab5e-416390ac3da5', '7e47e7d4-b7ff-4d97-bb62-7f53d42f67fa', 'e112af55-e02d-4665-a920-66fcd5fd0e16', '2b0407ae-a556-45ac-9611-1457aaffb2fa'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:37 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c" returned: 0 in 0.518s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:37 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 Sep 25 10:54:37 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:37 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:37 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:37 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 1073741824" returned: 0 in 0.628s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:37 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.286s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:38 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Deleted volume successfully. Sep 25 10:54:38 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 Sep 25 10:54:38 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-fda54cb1-8031-48c8-81a1-b56c536070ec tempest-VolumeDependencyTests-1716573902 None] Lock "cinder-97ec32ae-fe73-440e-9cf0-82bd04e1cc86-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:38 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599" returned: 0 in 0.471s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:38 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599 Sep 25 10:54:38 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:38 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74" returned: 0 in 0.319s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Attempting download of cd8b3d33-0489-4552-b18d-09da6ad322da ((None, [{'url': 'file:///opt/stack/data/glance/images/cd8b3d33-0489-4552-b18d-09da6ad322da', 'metadata': {}}])) to volume f5628d00-246e-46be-a246-f7277181fc74. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Acquiring lock "cinder-551c5780-9464-4a52-821b-d074938d9966-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dbf92c-f919-4c88-acd5-53c6b71af66b]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd8b3d33-0489-4552-b18d-09da6ad322da_hvt8g924 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:38 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c.e1ef6b19-f6e7-42ba-a05a-9661a415d599" returned: 0 in 0.319s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Lock "cinder-551c5780-9464-4a52-821b-d074938d9966-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-e1ef6b19-f6e7-42ba-a05a-9661a415d599" released by "_delete_snapshot" :: held 1.985s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-531486d3-c2ea-4618-bc0c-ab9988832f3c" released by "delete_snapshot" :: held 2.035s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Acquiring lock "cinder-quobyte-551c5780-9464-4a52-821b-d074938d9966" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:38 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd8b3d33-0489-4552-b18d-09da6ad322da_hvt8g924 Sep 25 10:54:38 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Lock "cinder-quobyte-551c5780-9464-4a52-821b-d074938d9966" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d0ef6-a58e-4047-b75f-72df55e191e8]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Created reservations ['c5c2028a-c56f-4846-9347-46b920edc1ff', 'ef0aad46-d0f0-48e8-a660-cdc8af6bdfac', '8c303320-5e0d-4fac-a208-2f26f9f91234', '6a3beb10-7fcc-434d-a4fd-aeda2ded06f0'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:38 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Delete snapshot completed successfully. Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-21df3e56-bb60-4103-a4ad-b90f829d4e6a tempest-ProjectMemberTests-1442491369 None] Lock "cinder-e1ef6b19-f6e7-42ba-a05a-9661a415d599-delete_snapshot" released by "delete_snapshot" :: held 2.321s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:38 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966 Sep 25 10:54:38 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:38 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd8b3d33-0489-4552-b18d-09da6ad322da_hvt8g924" returned: 0 in 0.476s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd8b3d33-0489-4552-b18d-09da6ad322da_hvt8g924 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:39 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd8b3d33-0489-4552-b18d-09da6ad322da_hvt8g924 Sep 25 10:54:39 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:39 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966" returned: 0 in 0.510s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:39 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966 Sep 25 10:54:39 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:39 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd8b3d33-0489-4552-b18d-09da6ad322da_hvt8g924" returned: 1 in 0.372s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd8b3d33-0489-4552-b18d-09da6ad322da_hvt8g924' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8240b5a8-e1c9-4743-98d2-f62c7d201fc3]: (4, 'raw') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:39 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD Sep 25 10:54:39 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:39 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-551c5780-9464-4a52-821b-d074938d9966" returned: 0 in 0.291s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Lock "cinder-quobyte-551c5780-9464-4a52-821b-d074938d9966" released by "delete_volume" :: held 0.881s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Created reservations ['f187977c-270a-4b68-884f-22156aad1399', '4132cb9c-aa70-43d5-b466-14b1abc98c6a', '7f4b84be-e8ec-4238-b8b6-24a4db203338', '7b09464d-1654-410a-9689-088325b1a012'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:39 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:39 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:39 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-531486d3-c2ea-4618-bc0c-ab9988832f3c-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-531486d3-c2ea-4618-bc0c-ab9988832f3c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-531486d3-c2ea-4618-bc0c-ab9988832f3c" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:39 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD Sep 25 10:54:39 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-531486d3-c2ea-4618-bc0c-ab9988832f3c" acquired by "delete_volume" :: waited 0.058s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[152487b6-16fb-4567-8459-d71a22cd8bb0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:40 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.429s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:40 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Deleted volume successfully. Sep 25 10:54:40 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c Sep 25 10:54:40 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-c086cb96-a3f3-484c-b67d-b5d1196f9a81 tempest-ProjectReaderTests-913968605 None] Lock "cinder-551c5780-9464-4a52-821b-d074938d9966-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:40 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD" returned: 1 in 0.460s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] cd8b3d33-0489-4552-b18d-09da6ad322da was raw, converting to qcow2 {{(pid=87242) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:40 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 Sep 25 10:54:40 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:40 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c" returned: 0 in 0.463s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:40 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c Sep 25 10:54:40 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:40 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-531486d3-c2ea-4618-bc0c-ab9988832f3c" returned: 0 in 0.346s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-531486d3-c2ea-4618-bc0c-ab9988832f3c" released by "delete_volume" :: held 0.946s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:40 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74" returned: 0 in 0.711s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd8b3d33-0489-4552-b18d-09da6ad322da_o_99gcoidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:54:40 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 10:54:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:41 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 1G Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Created reservations ['f85da737-e39f-46cb-8d49-028ff18659bc', '1663aea3-142b-45e0-8964-249a2c42a44f', '071548fe-e12c-4a7a-984b-559f1e8f53b2', '78dd9b3e-5462-43a7-9da0-a1656529df12'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:41 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:41 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:41 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:41 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:41 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.333s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 1G" returned: 0 in 0.486s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Downloaded image cd8b3d33-0489-4552-b18d-09da6ad322da ((None, [{'url': 'file:///opt/stack/data/glance/images/cd8b3d33-0489-4552-b18d-09da6ad322da', 'metadata': {}}])) to volume f5628d00-246e-46be-a246-f7277181fc74 successfully. {{(pid=87242) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Temporary image cd8b3d33-0489-4552-b18d-09da6ad322da for user ff5856bb6a0f46c0b2b31d3565c827e9 is deleted. {{(pid=87242) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.volume.volume_utils [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Marking volume f5628d00-246e-46be-a246-f7277181fc74 as bootable. {{(pid=87242) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 10:54:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Deleted volume successfully. Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Copying metadata from image cd8b3d33-0489-4552-b18d-09da6ad322da to f5628d00-246e-46be-a246-f7277181fc74. {{(pid=87242) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Creating volume glance metadata for volume f5628d00-246e-46be-a246-f7277181fc74 backed by image cd8b3d33-0489-4552-b18d-09da6ad322da with: {'image_id': 'cd8b3d33-0489-4552-b18d-09da6ad322da', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '075c115fcb6f18f06a8a60fd8347cfcc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87242) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-e33be2da-5107-4134-8ca8-3982e5c27257 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-531486d3-c2ea-4618-bc0c-ab9988832f3c-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc56b3a-0213-436c-bf12-a95a55a3004f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5628d00-246e-46be-a246-f7277181fc74', 'volume_size': 1, 'image_id': 'cd8b3d33-0489-4552-b18d-09da6ad322da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd8b3d33-0489-4552-b18d-09da6ad322da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '075c115fcb6f18f06a8a60fd8347cfcc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '13d18da3f91b4092ac197a4d0ad1191a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '296d0ebc5896aea830402835d29dad18578d5749f33162d3f637f82105d07ea5d46e90f8a0a7a912ffbfd9a775237420d0ff61f47daf5622f06c000546520e97', 'id': 'cd8b3d33-0489-4552-b18d-09da6ad322da', 'created_at': datetime.datetime(2026, 9, 25, 8, 54, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 8, 54, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd8b3d33-0489-4552-b18d-09da6ad322da/file', 'properties': {}}, 'image_service': }' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943183c6-7561-452a-aa66-5c6d62ec2ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:41 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Volume volume-f5628d00-246e-46be-a246-f7277181fc74 (f5628d00-246e-46be-a246-f7277181fc74): created successfully Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943183c6-7561-452a-aa66-5c6d62ec2ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:41 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Flow 'volume_create_manager' (aec668dd-9df0-4c07-8319-d8df5e855f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-42a79602-6060-4c2e-8fa1-3988cd83bcdb tempest-VolumeImageDependencyTests-1745700040 None] Created volume successfully. Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Acquiring lock "cinder-f5628d00-246e-46be-a246-f7277181fc74-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Lock "cinder-f5628d00-246e-46be-a246-f7277181fc74-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Acquiring lock "cinder-quobyte-f5628d00-246e-46be-a246-f7277181fc74" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Lock "cinder-quobyte-f5628d00-246e-46be-a246-f7277181fc74" acquired by "delete_volume" :: waited 0.041s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb8d065-c7e5-42d0-8f4c-4f2bfeb01cce]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:42 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 Sep 25 10:54:42 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (0ac2eec0-7f4d-4f97-9153-449b7b5685b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede05cda-7399-4b2d-bc3c-cac308e98cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede05cda-7399-4b2d-bc3c-cac308e98cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955282566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ff5018-3af9-4f93-965e-cf9cf02ca120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:43Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e0994d-db65-418d-9a6c-d68bbcac9d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e0994d-db65-418d-9a6c-d68bbcac9d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:42 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4d2f5d-bb8f-428a-86a8-2f70aac5cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4d2f5d-bb8f-428a-86a8-2f70aac5cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ff5018-3af9-4f93-965e-cf9cf02ca120', 'volume_name': 'volume-67ff5018-3af9-4f93-965e-cf9cf02ca120', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce70313d-8538-4b23-9bad-a664cff92e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce70313d-8538-4b23-9bad-a664cff92e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819e979c-578e-4f61-a68b-7359629c62bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:43 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Volume 67ff5018-3af9-4f93-965e-cf9cf02ca120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ff5018-3af9-4f93-965e-cf9cf02ca120', 'volume_size': 1} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955282566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ff5018-3af9-4f93-965e-cf9cf02ca120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:43Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Creating volume 67ff5018-3af9-4f93-965e-cf9cf02ca120 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:43 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:43 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 1073741824 Sep 25 10:54:43 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:43 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74" returned: 0 in 0.681s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:43 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74 Sep 25 10:54:43 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:43 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 1073741824" returned: 0 in 0.686s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:43 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-f5628d00-246e-46be-a246-f7277181fc74" returned: 0 in 0.411s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Lock "cinder-quobyte-f5628d00-246e-46be-a246-f7277181fc74" released by "delete_volume" :: held 1.194s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:43 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 Sep 25 10:54:43 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Created reservations ['c1a15994-bc06-41b6-bedf-6dec1a5155b6', 'a9bac316-d813-4410-8d46-5da052c19c84', 'bc1b76f4-a09a-4bf7-b262-11d7bc5a4877', 'bdaa177d-c9be-4768-b819-ffe713f06167'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:44 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:44 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-9c5b9531-9004-4434-be64-088388ebd11d tempest-ProjectAdminTests-1538498964 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4611167907715, 'free_capacity_gb': 1775.4611167907715, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87242) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 10:54:44 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120" returned: 0 in 0.425s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819e979c-578e-4f61-a68b-7359629c62bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ff5018-3af9-4f93-965e-cf9cf02ca120', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b93685f-d486-43e0-b2d7-a307afd44c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:44 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Volume volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 (67ff5018-3af9-4f93-965e-cf9cf02ca120): created successfully Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b93685f-d486-43e0-b2d7-a307afd44c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (0ac2eec0-7f4d-4f97-9153-449b7b5685b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-589e3865-9037-4475-9557-3b8d1a2e468e tempest-ProjectMemberTests-1442491369 None] Created volume successfully. Sep 25 10:54:44 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.419s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Deleted volume successfully. Sep 25 10:54:44 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-5914aa80-f781-44bd-9005-4567e39b3733 tempest-VolumeImageDependencyTests-1745700040 None] Lock "cinder-f5628d00-246e-46be-a246-f7277181fc74-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Creating offline snapshot 93aa0934-51dd-4d89-9830-efdadc81a99f of volume 67ff5018-3af9-4f93-965e-cf9cf02ca120 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:54:45 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc50c1b-97ba-423c-8706-41d6b4c31bdc]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:45 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 Sep 25 10:54:45 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:46 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120" returned: 0 in 0.523s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:46 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f 1G Sep 25 10:54:46 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:46 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f 1G" returned: 0 in 0.675s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:46 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f Sep 25 10:54:46 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:47 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f" returned: 0 in 0.740s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:47 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f is being set with open permissions: ugo+rw Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:47 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f Sep 25 10:54:47 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Flow 'volume_create_manager' (e169d44f-be99-4ba2-a6ac-05b214d3a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e1e414-b80c-4952-bca0-f379f714cdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e1e414-b80c-4952-bca0-f379f714cdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-934268516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58eaa1ad-1d81-4cab-94d2-157b9ea5fad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68c87ce46a840aeb423950b1a308694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:48Z,use_quota=True,user_id='bb413c5f77d64dac8b05507dbad53c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f7c71f-bfa5-43af-babc-c39c039609df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f7c71f-bfa5-43af-babc-c39c039609df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90bfb5f-7e4a-4af1-a95d-a33e1749a101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90bfb5f-7e4a-4af1-a95d-a33e1749a101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58eaa1ad-1d81-4cab-94d2-157b9ea5fad7', 'volume_name': 'volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5316dbe-5b8a-44b3-a46c-acfdf4ceda4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5316dbe-5b8a-44b3-a46c-acfdf4ceda4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31ec4d0-a77e-4067-ae34-69b9b566166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:47 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Volume 58eaa1ad-1d81-4cab-94d2-157b9ea5fad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7', 'volume_size': 1} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:47 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f" returned: 0 in 0.435s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:48 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.info Sep 25 10:54:48 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:48 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.info" returned: 0 in 0.319s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:48 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.info is being set with open permissions: ugo+rw Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:48 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.info Sep 25 10:54:48 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:48 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.info" returned: 0 in 0.369s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.194s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-934268516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58eaa1ad-1d81-4cab-94d2-157b9ea5fad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68c87ce46a840aeb423950b1a308694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:48Z,use_quota=True,user_id='bb413c5f77d64dac8b05507dbad53c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Creating volume 58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:48 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:48 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 1073741824 Sep 25 10:54:48 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:48 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-de85dfbd-2993-44ca-a1a0-d2cc75708d7c tempest-ProjectMemberTests-1442491369 None] Create snapshot completed successfully Sep 25 10:54:49 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 1073741824" returned: 0 in 0.583s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:49 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 Sep 25 10:54:49 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:49 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31ec4d0-a77e-4067-ae34-69b9b566166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db19d782-f022-42b4-9c76-ee92b3d7d02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:49 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Volume volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 (58eaa1ad-1d81-4cab-94d2-157b9ea5fad7): created successfully Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db19d782-f022-42b4-9c76-ee92b3d7d02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Flow 'volume_create_manager' (e169d44f-be99-4ba2-a6ac-05b214d3a44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-93aa0934-51dd-4d89-9830-efdadc81a99f-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:49 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e6c207fc-089b-4a64-b405-97ee1399c68e tempest-ProjectReaderTests-1416404155 None] Created volume successfully. Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-93aa0934-51dd-4d89-9830-efdadc81a99f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-67ff5018-3af9-4f93-965e-cf9cf02ca120" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-67ff5018-3af9-4f93-965e-cf9cf02ca120" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-93aa0934-51dd-4d89-9830-efdadc81a99f" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-93aa0934-51dd-4d89-9830-efdadc81a99f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Deleting offline snapshot 93aa0934-51dd-4d89-9830-efdadc81a99f of volume 67ff5018-3af9-4f93-965e-cf9cf02ca120 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] snapshot_file for this snap is: volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[11666e99-9fc7-4931-8c0c-02c843900709]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:50 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f Sep 25 10:54:50 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:50 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f" returned: 0 in 0.531s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ff5018-3af9-4f93-965e-cf9cf02ca120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:54:50 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc62d5e-1eaa-422d-ada1-a517971bb8da]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:50 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 Sep 25 10:54:50 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:51 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120" returned: 0 in 0.587s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:51 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f Sep 25 10:54:51 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Acquiring lock "cinder-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Lock "cinder-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Acquiring lock "cinder-quobyte-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Lock "cinder-quobyte-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:51 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a066102-3667-4699-9f4a-aecd8574c206]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:51 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f" returned: 0 in 0.562s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:51 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f Sep 25 10:54:51 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 Sep 25 10:54:51 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:51 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:52 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120.93aa0934-51dd-4d89-9830-efdadc81a99f" returned: 0 in 0.371s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-93aa0934-51dd-4d89-9830-efdadc81a99f" released by "_delete_snapshot" :: held 2.258s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:52 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-67ff5018-3af9-4f93-965e-cf9cf02ca120" released by "delete_snapshot" :: held 2.300s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7" returned: 0 in 0.599s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:52 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7 Sep 25 10:54:52 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Created reservations ['87a9d7df-bb29-421a-80a8-eb0d20039505', '0e8922a6-d394-43f8-baf2-05a5711f295b', '38176be1-ea1a-48f8-988e-afa8121b990a', 'dd90d0aa-a35e-4df9-aa4f-7c29d1826bf2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:52 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Delete snapshot completed successfully. Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bbd1a7e0-d452-416a-bfa7-3b9d9b5430e9 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-93aa0934-51dd-4d89-9830-efdadc81a99f-delete_snapshot" released by "delete_snapshot" :: held 2.586s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:52 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7" returned: 0 in 0.339s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Lock "cinder-quobyte-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7" released by "delete_volume" :: held 1.008s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Created reservations ['ffac121d-bc06-4bad-98fd-4a51b7c8f409', '3dc51949-62a3-4242-8cd1-47ab2ec8d1d5', '4bb425bf-3f20-42a3-9c05-0dc85fdc4a90', '67a26a6e-9e0d-4fe4-9eac-f531b5fdee8b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:52 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:52 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:53 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.315s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:53 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Deleted volume successfully. Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-da1ddaf1-803a-471e-b504-e002d231aa00 tempest-ProjectReaderTests-1416404155 None] Lock "cinder-58eaa1ad-1d81-4cab-94d2-157b9ea5fad7-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-67ff5018-3af9-4f93-965e-cf9cf02ca120-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Lock "cinder-67ff5018-3af9-4f93-965e-cf9cf02ca120-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-67ff5018-3af9-4f93-965e-cf9cf02ca120" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-67ff5018-3af9-4f93-965e-cf9cf02ca120" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a72312-f5c9-4ce6-9c8c-728eaf9805c1]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:53 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 Sep 25 10:54:53 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:53 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120" returned: 0 in 0.504s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:53 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120 Sep 25 10:54:53 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:54 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-67ff5018-3af9-4f93-965e-cf9cf02ca120" returned: 0 in 0.457s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-67ff5018-3af9-4f93-965e-cf9cf02ca120" released by "delete_volume" :: held 1.077s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Flow 'volume_create_manager' (343d5385-afc8-4826-a7e1-211dbcec7b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90154a45-0339-4c52-a99a-2348a3bb3953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90154a45-0339-4c52-a99a-2348a3bb3953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786211705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2781f5de-05f1-4b24-9996-b86f9f01ed5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68c87ce46a840aeb423950b1a308694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:54Z,use_quota=True,user_id='bb413c5f77d64dac8b05507dbad53c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f96c522-9d28-4ede-933b-e3108a35efda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f96c522-9d28-4ede-933b-e3108a35efda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a56f06-ec7d-487f-a5ae-6d07c23cd1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a56f06-ec7d-487f-a5ae-6d07c23cd1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2781f5de-05f1-4b24-9996-b86f9f01ed5d', 'volume_name': 'volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c1e863-5ec5-4865-b6db-d43cf4e9a065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c1e863-5ec5-4865-b6db-d43cf4e9a065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e91f75-87ff-4392-b7dd-895fa3835585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:54 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Volume 2781f5de-05f1-4b24-9996-b86f9f01ed5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d', 'volume_size': 1} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786211705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2781f5de-05f1-4b24-9996-b86f9f01ed5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68c87ce46a840aeb423950b1a308694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:54Z,use_quota=True,user_id='bb413c5f77d64dac8b05507dbad53c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Creating volume 2781f5de-05f1-4b24-9996-b86f9f01ed5d {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:54 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Created reservations ['65b71fc9-8c17-4fdc-8929-5eaac0f2db65', '5d912837-832f-4b44-b0a2-e6a1e558864b', '8d2af5c9-722f-4c4e-8f99-c98945e85489', 'a9caa89c-fdf2-4e9e-a6c5-3469cc09700d'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:54 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d 1073741824 Sep 25 10:54:54 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:54 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:54 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:55 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:55 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Deleted volume successfully. Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f6451bfd-6634-4c05-b9eb-325988a2316f tempest-ProjectMemberTests-1442491369 None] Lock "cinder-67ff5018-3af9-4f93-965e-cf9cf02ca120-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:55 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d 1073741824" returned: 0 in 0.645s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:55 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d Sep 25 10:54:55 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:55 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d" returned: 0 in 0.380s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e91f75-87ff-4392-b7dd-895fa3835585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661d4579-c967-4d0f-b576-bad9fdcd77b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:55 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Volume volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d (2781f5de-05f1-4b24-9996-b86f9f01ed5d): created successfully Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661d4579-c967-4d0f-b576-bad9fdcd77b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:55 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Flow 'volume_create_manager' (343d5385-afc8-4826-a7e1-211dbcec7b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:55 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-6eccb021-10f5-404b-a99d-a0d7e600b3da tempest-ProjectReaderTests-1416404155 None] Created volume successfully. Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (4b6346e2-ff91-4150-b824-fd15a7e81cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f1b8c6-ec6b-49ce-9831-db1eacec4a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f1b8c6-ec6b-49ce-9831-db1eacec4a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825223657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ca0786-3cd5-4f74-abce-5ac01f8ab40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:56Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625d7f1e-4f64-4a44-80f8-47c99ae90c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625d7f1e-4f64-4a44-80f8-47c99ae90c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048f4e60-d8da-4ee5-aacc-aecc5ba95a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048f4e60-d8da-4ee5-aacc-aecc5ba95a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43ca0786-3cd5-4f74-abce-5ac01f8ab40f', 'volume_name': 'volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca174255-86cd-4774-a076-9ab4388329d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca174255-86cd-4774-a076-9ab4388329d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0454cfa0-a53c-4721-8359-ef0e907fc2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:56 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Volume 43ca0786-3cd5-4f74-abce-5ac01f8ab40f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f', 'volume_size': 1} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825223657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ca0786-3cd5-4f74-abce-5ac01f8ab40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:56Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Creating volume 43ca0786-3cd5-4f74-abce-5ac01f8ab40f {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:54:56 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:56 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f 1073741824 Sep 25 10:54:56 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Acquiring lock "cinder-2781f5de-05f1-4b24-9996-b86f9f01ed5d-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Lock "cinder-2781f5de-05f1-4b24-9996-b86f9f01ed5d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Acquiring lock "cinder-quobyte-2781f5de-05f1-4b24-9996-b86f9f01ed5d" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Lock "cinder-quobyte-2781f5de-05f1-4b24-9996-b86f9f01ed5d" acquired by "delete_volume" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6821d18e-997a-4272-bb96-96fc31ad5380]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:56 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f 1073741824" returned: 0 in 0.639s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:56 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d Sep 25 10:54:56 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:57 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f Sep 25 10:54:57 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:57 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" returned: 0 in 0.292s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0454cfa0-a53c-4721-8359-ef0e907fc2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303eaa16-9a99-42ee-a0cf-ecf14a2df120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:57 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Volume volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f (43ca0786-3cd5-4f74-abce-5ac01f8ab40f): created successfully Sep 25 10:54:57 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303eaa16-9a99-42ee-a0cf-ecf14a2df120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (4b6346e2-ff91-4150-b824-fd15a7e81cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d" returned: 0 in 0.564s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:57 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d73e0942-8802-4ed0-86c9-7acb32340a7c tempest-ProjectMemberTests-1442491369 None] Created volume successfully. Sep 25 10:54:57 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d Sep 25 10:54:57 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:57 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2781f5de-05f1-4b24-9996-b86f9f01ed5d" returned: 0 in 0.307s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Lock "cinder-quobyte-2781f5de-05f1-4b24-9996-b86f9f01ed5d" released by "delete_volume" :: held 0.929s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Created reservations ['50edb79c-3c30-45e2-bfb1-4d0c9199d1cf', '1c19ad20-def9-462d-96e3-bb36bbbbba54', 'b1cf3a81-0e6c-414e-a3d3-3d6497e1217e', '2a279f3d-9b3a-4bfd-acb1-82cff7b86853'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:54:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:57 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:54:57 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:58 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.281s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:58 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:54:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Deleted volume successfully. Sep 25 10:54:58 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8f9fa6bd-3756-4234-b03c-479945006d99 tempest-ProjectReaderTests-1416404155 None] Lock "cinder-2781f5de-05f1-4b24-9996-b86f9f01ed5d-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:54:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:54:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Creating offline snapshot 0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 of volume 43ca0786-3cd5-4f74-abce-5ac01f8ab40f {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:54:58 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a902a36f-a2d1-438f-ab28-2c4efe76e0ce]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:54:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:58 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f Sep 25 10:54:58 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:59 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" returned: 0 in 0.473s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:59 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 1G Sep 25 10:54:59 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Flow 'volume_create_manager' (90c12ef2-237a-4458-86ce-c4babf9f7fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d88810c-c530-424b-b450-bbad183dd2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d88810c-c530-424b-b450-bbad183dd2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1548214103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5b23ab-44a1-4270-b743-edd0de9e869e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ccd728024f148fb11ed8539cfe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:59Z,use_quota=True,user_id='fd56553ef074402487a7f8847e0ab3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15fac1a-5658-440f-ba1a-e7852b2df935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15fac1a-5658-440f-ba1a-e7852b2df935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfaeabf-2d64-45f8-bb3f-1b504bb1b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfaeabf-2d64-45f8-bb3f-1b504bb1b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5b23ab-44a1-4270-b743-edd0de9e869e', 'volume_name': 'volume-4c5b23ab-44a1-4270-b743-edd0de9e869e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b7ba6c-659c-4bf3-b0da-127c23b00858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b7ba6c-659c-4bf3-b0da-127c23b00858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a1406a-7462-438a-8dc5-e7fa5df3067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:59 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Volume 4c5b23ab-44a1-4270-b743-edd0de9e869e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5b23ab-44a1-4270-b743-edd0de9e869e', 'volume_size': 1} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Flow 'volume_create_manager' (0b9d77a9-8200-402a-b6ba-383bfedca9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37acb2b0-d76c-451a-b868-ceaf7b705c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37acb2b0-d76c-451a-b868-ceaf7b705c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136411127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3538ec4-cf64-4078-b9dc-bb5268a95aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68c87ce46a840aeb423950b1a308694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:00Z,use_quota=True,user_id='bb413c5f77d64dac8b05507dbad53c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6349e9-9559-4674-ad9f-ead0e9029df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6349e9-9559-4674-ad9f-ead0e9029df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:59 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98315909-045f-489b-b7b8-512f9399f33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98315909-045f-489b-b7b8-512f9399f33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3538ec4-cf64-4078-b9dc-bb5268a95aef', 'volume_name': 'volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56449db0-c319-4fd0-9c75-061494e03289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56449db0-c319-4fd0-9c75-061494e03289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1454df73-2597-4d84-94bf-515cabce421a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:54:59 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Volume a3538ec4-cf64-4078-b9dc-bb5268a95aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef', 'volume_size': 1} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 1G" returned: 0 in 0.697s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:54:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:54:59 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 Sep 25 10:54:59 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:00 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0" returned: 0 in 0.353s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:00 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 is being set with open permissions: ugo+rw Sep 25 10:55:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:00 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 Sep 25 10:55:00 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:00 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0" returned: 0 in 0.385s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:00 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.info Sep 25 10:55:00 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:00 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.info" returned: 0 in 0.330s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:00 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.info is being set with open permissions: ugo+rw Sep 25 10:55:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:00 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.info Sep 25 10:55:00 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:01 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.info" returned: 0 in 0.351s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1548214103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5b23ab-44a1-4270-b743-edd0de9e869e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ccd728024f148fb11ed8539cfe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:54:59Z,use_quota=True,user_id='fd56553ef074402487a7f8847e0ab3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Creating volume 4c5b23ab-44a1-4270-b743-edd0de9e869e {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:01 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:01 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e 1073741824 Sep 25 10:55:01 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:01 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-9d01d31b-8091-4fd4-8ddc-14289227b1a3 tempest-ProjectMemberTests-1442491369 None] Create snapshot completed successfully Sep 25 10:55:01 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e 1073741824" returned: 0 in 0.611s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:02 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e Sep 25 10:55:02 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Deleting offline snapshot 0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 of volume 43ca0786-3cd5-4f74-abce-5ac01f8ab40f {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] snapshot_file for this snap is: volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[690ffc26-fe0a-42a6-a67d-4157bef05e9e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:02 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 Sep 25 10:55:02 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:02 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e" returned: 0 in 0.374s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136411127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3538ec4-cf64-4078-b9dc-bb5268a95aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68c87ce46a840aeb423950b1a308694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:00Z,use_quota=True,user_id='bb413c5f77d64dac8b05507dbad53c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Creating volume a3538ec4-cf64-4078-b9dc-bb5268a95aef {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:02 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a1406a-7462-438a-8dc5-e7fa5df3067a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5b23ab-44a1-4270-b743-edd0de9e869e', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4a712a-4c59-4107-aa24-ec955f64bf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:02 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef 1073741824 Sep 25 10:55:02 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:02 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Volume volume-4c5b23ab-44a1-4270-b743-edd0de9e869e (4c5b23ab-44a1-4270-b743-edd0de9e869e): created successfully Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4a712a-4c59-4107-aa24-ec955f64bf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Flow 'volume_create_manager' (90c12ef2-237a-4458-86ce-c4babf9f7fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:02 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d74e2df1-5315-4cac-ad33-f69e3c4f4931 tempest-ProjectReaderTests-1317390258 None] Created volume successfully. Sep 25 10:55:02 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0" returned: 0 in 0.537s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe8a866-c7ab-4545-8fa6-1bc567c02040]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:02 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f Sep 25 10:55:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:02 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:03 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef 1073741824" returned: 0 in 0.714s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:03 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef Sep 25 10:55:03 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:03 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" returned: 0 in 0.625s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:03 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 Sep 25 10:55:03 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:03 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef" returned: 0 in 0.323s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.518s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:03 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:03 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1454df73-2597-4d84-94bf-515cabce421a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fcc076-053e-4f5a-89a9-e30efc1baa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Creating offline snapshot 17072d9d-774a-4e21-912d-85d96f88fe94 of volume 4c5b23ab-44a1-4270-b743-edd0de9e869e {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:03 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Volume volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef (a3538ec4-cf64-4078-b9dc-bb5268a95aef): created successfully Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fcc076-053e-4f5a-89a9-e30efc1baa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Flow 'volume_create_manager' (0b9d77a9-8200-402a-b6ba-383bfedca9f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f711786-385d-45c5-bfb1-3689ef04f84d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:03 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-366a5ade-a5a4-495e-ad3d-d94494abbcc1 tempest-ProjectReaderTests-1416404155 None] Created volume successfully. Sep 25 10:55:03 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e Sep 25 10:55:03 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:03 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0" returned: 0 in 0.409s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:03 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0 Sep 25 10:55:03 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:03 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.385s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:55:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:55:04 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e" returned: 0 in 0.502s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:04 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f.0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0" returned: 0 in 0.325s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:04 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 1G Sep 25 10:55:04 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Acquiring lock "cinder-a3538ec4-cf64-4078-b9dc-bb5268a95aef-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0" released by "_delete_snapshot" :: held 2.076s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" released by "delete_snapshot" :: held 2.113s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Lock "cinder-a3538ec4-cf64-4078-b9dc-bb5268a95aef-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Acquiring lock "cinder-quobyte-a3538ec4-cf64-4078-b9dc-bb5268a95aef" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Lock "cinder-quobyte-a3538ec4-cf64-4078-b9dc-bb5268a95aef" acquired by "delete_volume" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ce16a-8d4b-4e5e-a25b-34ad112e19b8]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Created reservations ['25561b37-ba11-4f7c-b5eb-6dc1e7876c9a', '46cd427c-d6dc-4456-934f-0a9af0960f73', 'a0ea571a-2be3-4762-b62f-3478d169c867', '748cdfac-72c3-422b-b389-4a891aea6bde'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:04 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Delete snapshot completed successfully. Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-bfecea67-dd77-493a-a662-ed1c8ceca853 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-0d9b1dc4-b5e4-46c6-ac6d-4e8d31025da0-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:04 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef Sep 25 10:55:04 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:04 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 1G" returned: 0 in 0.529s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5b23ab-44a1-4270-b743-edd0de9e869e -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:04 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5b23ab-44a1-4270-b743-edd0de9e869e -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 Sep 25 10:55:04 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:04 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef" returned: 0 in 0.474s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:04 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef Sep 25 10:55:04 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:04 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5b23ab-44a1-4270-b743-edd0de9e869e -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94" returned: 0 in 0.324s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:04 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 is being set with open permissions: ugo+rw Sep 25 10:55:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:04 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 Sep 25 10:55:04 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:05 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-a3538ec4-cf64-4078-b9dc-bb5268a95aef" returned: 0 in 0.284s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Lock "cinder-quobyte-a3538ec4-cf64-4078-b9dc-bb5268a95aef" released by "delete_volume" :: held 0.811s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Created reservations ['2a60021d-638f-465b-8313-b71e292e5d4d', '38d35f42-7ab0-456a-bd7b-aab1073277ad', 'f660f494-7c73-4cb5-806f-94b460f53cfa', '13474daa-94fc-48fa-a3ab-d97ee32f93ee'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:05 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94" returned: 0 in 0.292s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:05 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:05 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-43ca0786-3cd5-4f74-abce-5ac01f8ab40f-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Lock "cinder-43ca0786-3cd5-4f74-abce-5ac01f8ab40f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:05 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.info Sep 25 10:55:05 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:05 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.356s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:05 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Deleted volume successfully. Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" acquired by "delete_volume" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23c2201-246d-4cac-8e62-10217c052390]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:05 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.info" returned: 0 in 0.312s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:05 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.info is being set with open permissions: ugo+rw Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-df2c1d56-af22-461c-a95b-8d3575ecfb8c tempest-ProjectReaderTests-1416404155 None] Lock "cinder-a3538ec4-cf64-4078-b9dc-bb5268a95aef-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:05 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.info Sep 25 10:55:05 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:05 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f Sep 25 10:55:05 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:06 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.info" returned: 0 in 0.380s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:06 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" returned: 0 in 0.444s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:06 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f Sep 25 10:55:06 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:06 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5c7b4926-2021-4d98-9df9-62063fb6d91e tempest-ProjectReaderTests-1317390258 None] Create snapshot completed successfully Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Flow 'volume_create_manager' (3b48f10f-f56b-4cad-8c06-1925946ac144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e75066-55c7-4ba2-a2e1-0c43c64bc6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e75066-55c7-4ba2-a2e1-0c43c64bc6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1503371161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b571a89d-fdef-4084-b7e5-ddb7c5b3d495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68c87ce46a840aeb423950b1a308694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:06Z,use_quota=True,user_id='bb413c5f77d64dac8b05507dbad53c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033a282c-02db-4019-9314-21503be741a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033a282c-02db-4019-9314-21503be741a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285ab712-5559-436c-bd3f-8eda924f0007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285ab712-5559-436c-bd3f-8eda924f0007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b571a89d-fdef-4084-b7e5-ddb7c5b3d495', 'volume_name': 'volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f1a5e7-88a0-44ab-9bd1-06a05a488660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f1a5e7-88a0-44ab-9bd1-06a05a488660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9283eeff-178c-4aa1-8d31-185432b8f295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:06 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Volume b571a89d-fdef-4084-b7e5-ddb7c5b3d495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495', 'volume_size': 1} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1503371161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b571a89d-fdef-4084-b7e5-ddb7c5b3d495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68c87ce46a840aeb423950b1a308694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:06Z,use_quota=True,user_id='bb413c5f77d64dac8b05507dbad53c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Creating volume b571a89d-fdef-4084-b7e5-ddb7c5b3d495 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:06 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:06 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495 1073741824 Sep 25 10:55:06 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:06 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" returned: 0 in 0.298s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-43ca0786-3cd5-4f74-abce-5ac01f8ab40f" released by "delete_volume" :: held 0.831s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Created reservations ['e882c459-97a5-45c5-9d3a-e82607402677', 'be41513c-85cc-46f5-896b-9aeb21493f51', '0d565669-99b4-4d69-93e9-14cf444b52b1', '0a11e8a8-57e6-49d0-8aa6-543e385eb8be'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:06 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:06 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:06 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495 1073741824" returned: 0 in 0.542s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:07 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.337s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Deleted volume successfully. Sep 25 10:55:07 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495 Sep 25 10:55:07 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f99de001-ece3-4a46-9ca3-612726f5442b tempest-ProjectMemberTests-1442491369 None] Lock "cinder-43ca0786-3cd5-4f74-abce-5ac01f8ab40f-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:07 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9283eeff-178c-4aa1-8d31-185432b8f295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1aef4a5-5a36-4a5c-aa83-c5ade4d5561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:07 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Volume volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495 (b571a89d-fdef-4084-b7e5-ddb7c5b3d495): created successfully Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1aef4a5-5a36-4a5c-aa83-c5ade4d5561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Flow 'volume_create_manager' (3b48f10f-f56b-4cad-8c06-1925946ac144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:07 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b566d690-36c1-41b4-b83f-c31a586d9a2e tempest-ProjectReaderTests-1416404155 None] Created volume successfully. Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-17072d9d-774a-4e21-912d-85d96f88fe94-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Lock "cinder-17072d9d-774a-4e21-912d-85d96f88fe94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-4c5b23ab-44a1-4270-b743-edd0de9e869e" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-4c5b23ab-44a1-4270-b743-edd0de9e869e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-17072d9d-774a-4e21-912d-85d96f88fe94" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-17072d9d-774a-4e21-912d-85d96f88fe94" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Deleting offline snapshot 17072d9d-774a-4e21-912d-85d96f88fe94 of volume 4c5b23ab-44a1-4270-b743-edd0de9e869e {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] snapshot_file for this snap is: volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b4e994-0fd0-49c8-8454-534d42489943]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:07 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 Sep 25 10:55:07 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:08 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94" returned: 0 in 0.447s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c5b23ab-44a1-4270-b743-edd0de9e869e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d20eb-3029-4132-aaae-a3b07e22f4ba]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:08 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e Sep 25 10:55:08 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (a0e40c8b-c618-4e9e-ad4b-0f93fd5afc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2c0a7e-bceb-4fda-aebe-1b5d344453aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2c0a7e-bceb-4fda-aebe-1b5d344453aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081002289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f4b1c5f-429c-4a48-9541-d8aa4f469bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:08Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560d8ad5-61f1-4549-8942-936969d14df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560d8ad5-61f1-4549-8942-936969d14df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b5dfe4-9810-4624-89f7-c0a6f44e159f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b5dfe4-9810-4624-89f7-c0a6f44e159f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f4b1c5f-429c-4a48-9541-d8aa4f469bb8', 'volume_name': 'volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdb7d4e-3bff-46fb-84f1-11cdcca32e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdb7d4e-3bff-46fb-84f1-11cdcca32e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4730956a-6d74-472d-8ee0-f82be7476f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:08 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Volume 0f4b1c5f-429c-4a48-9541-d8aa4f469bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8', 'volume_size': 1} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2081002289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f4b1c5f-429c-4a48-9541-d8aa4f469bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:08Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Creating volume 0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:08 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:08 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 1073741824 Sep 25 10:55:08 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Acquiring lock "cinder-b571a89d-fdef-4084-b7e5-ddb7c5b3d495-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Lock "cinder-b571a89d-fdef-4084-b7e5-ddb7c5b3d495-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Acquiring lock "cinder-quobyte-b571a89d-fdef-4084-b7e5-ddb7c5b3d495" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Lock "cinder-quobyte-b571a89d-fdef-4084-b7e5-ddb7c5b3d495" acquired by "delete_volume" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[533efa52-4d39-4c16-968b-32cae982d6ac]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:08 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e" returned: 0 in 0.448s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:08 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 Sep 25 10:55:08 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:08 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495 Sep 25 10:55:08 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:08 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 1073741824" returned: 0 in 0.605s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:09 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495" returned: 0 in 0.470s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:09 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94" returned: 0 in 0.455s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:09 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495 Sep 25 10:55:09 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:09 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94 Sep 25 10:55:09 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:09 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 Sep 25 10:55:09 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:09 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-b571a89d-fdef-4084-b7e5-ddb7c5b3d495" returned: 0 in 0.267s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Lock "cinder-quobyte-b571a89d-fdef-4084-b7e5-ddb7c5b3d495" released by "delete_volume" :: held 0.795s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:09 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e.17072d9d-774a-4e21-912d-85d96f88fe94" returned: 0 in 0.315s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:09 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" returned: 0 in 0.322s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-17072d9d-774a-4e21-912d-85d96f88fe94" released by "_delete_snapshot" :: held 1.805s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-4c5b23ab-44a1-4270-b743-edd0de9e869e" released by "delete_snapshot" :: held 1.830s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4730956a-6d74-472d-8ee0-f82be7476f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efda0697-97f9-4d4b-b5fb-0c0a9a5ad3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:09 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Volume volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 (0f4b1c5f-429c-4a48-9541-d8aa4f469bb8): created successfully Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efda0697-97f9-4d4b-b5fb-0c0a9a5ad3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (a0e40c8b-c618-4e9e-ad4b-0f93fd5afc42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Created reservations ['6d42a91c-5199-463b-ab98-32b3f1f9e75f', '2adbc1a7-1c46-435c-b9a7-d84284de89e3', 'cdc27abf-af1e-440c-ae99-217dace6f88e', 'a1e407bf-fdad-49bd-834e-a539fac4f9b1'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3dd58251-64a2-44bb-ad9e-3f5d6423531a tempest-ProjectMemberTests-1442491369 None] Created volume successfully. Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Created reservations ['77ae0c08-4ac1-46cb-879d-338d91ab3812', '40ddf40c-db52-4f58-a1ce-1d45c5be8ff9', 'c294bfdb-6ea6-4efa-80d0-463f81b203a9', 'd8cb908f-0c26-4d98-adae-3f69c5cf51b2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:09 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:09 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Delete snapshot completed successfully. Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-8717c78b-8c65-4e34-bd29-7e24b657387f tempest-ProjectReaderTests-1317390258 None] Lock "cinder-17072d9d-774a-4e21-912d-85d96f88fe94-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-4c5b23ab-44a1-4270-b743-edd0de9e869e-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-4c5b23ab-44a1-4270-b743-edd0de9e869e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-4c5b23ab-44a1-4270-b743-edd0de9e869e" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-4c5b23ab-44a1-4270-b743-edd0de9e869e" acquired by "delete_volume" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7e4b0b-359d-41ec-a205-6a4cb073dd97]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:09 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.389s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:09 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:09 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Deleted volume successfully. Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-2f946525-c0bd-4069-961f-81053e936dce tempest-ProjectReaderTests-1416404155 None] Lock "cinder-b571a89d-fdef-4084-b7e5-ddb7c5b3d495-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:10 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e Sep 25 10:55:10 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:10 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e" returned: 0 in 0.468s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:10 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e Sep 25 10:55:10 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Creating offline snapshot 09eb5125-812d-4871-b0dd-e5a37df62a9f of volume 0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c198cad6-2bfc-46d1-a9cd-cc020ec1839f]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:10 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-4c5b23ab-44a1-4270-b743-edd0de9e869e" returned: 0 in 0.322s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-4c5b23ab-44a1-4270-b743-edd0de9e869e" released by "delete_volume" :: held 0.892s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:10 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 Sep 25 10:55:10 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Created reservations ['5d8bb3f6-5343-447a-8f34-0bb45dbe7b8b', 'c363373b-2830-4c91-84d9-d85b14679c74', 'aa5f194a-3968-4043-af88-b4496118086c', '05b4d13d-cecf-46d9-8e5f-983c38468e9e'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:10 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:10 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:11 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" returned: 0 in 0.502s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:11 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f 1G Sep 25 10:55:11 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:11 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.302s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:11 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Deleted volume successfully. Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-d9cfe674-4096-4a8c-8c9f-b6d37d585005 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-4c5b23ab-44a1-4270-b743-edd0de9e869e-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Flow 'volume_create_manager' (e0ab895c-b807-429f-88bb-45bf736e1b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f0847f-ad8e-42a6-863c-807df9322c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f0847f-ad8e-42a6-863c-807df9322c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-6729540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c249aaf-c736-425e-913f-7971b759ede8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ccd728024f148fb11ed8539cfe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:12Z,use_quota=True,user_id='fd56553ef074402487a7f8847e0ab3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6626c2-507b-4f78-bacf-0075ccc80827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6626c2-507b-4f78-bacf-0075ccc80827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39facb3b-010c-42c4-a4e2-0708ac90f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39facb3b-010c-42c4-a4e2-0708ac90f324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c249aaf-c736-425e-913f-7971b759ede8', 'volume_name': 'volume-5c249aaf-c736-425e-913f-7971b759ede8', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db959b0a-8305-4458-bc1d-99a0b35b17b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db959b0a-8305-4458-bc1d-99a0b35b17b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ceea988-8e84-4f9f-8a9d-bae7b51a397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:11 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Volume 5c249aaf-c736-425e-913f-7971b759ede8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c249aaf-c736-425e-913f-7971b759ede8', 'volume_size': 1} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:11 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f 1G" returned: 0 in 0.585s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:11 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:11 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f Sep 25 10:55:11 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:12 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f" returned: 0 in 0.341s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:12 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f is being set with open permissions: ugo+rw Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:12 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f Sep 25 10:55:12 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:12 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f" returned: 0 in 0.248s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:12 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.info Sep 25 10:55:12 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:12 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.info" returned: 0 in 0.268s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:12 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.info is being set with open permissions: ugo+rw Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:12 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.info Sep 25 10:55:12 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:12 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.info" returned: 0 in 0.254s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-6729540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c249aaf-c736-425e-913f-7971b759ede8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ccd728024f148fb11ed8539cfe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:12Z,use_quota=True,user_id='fd56553ef074402487a7f8847e0ab3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Creating volume 5c249aaf-c736-425e-913f-7971b759ede8 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:12 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:12 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:12 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 1073741824 Sep 25 10:55:12 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:12 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1980f134-a87a-4194-82e8-726dbacecb87 tempest-ProjectMemberTests-1442491369 None] Create snapshot completed successfully Sep 25 10:55:13 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 1073741824" returned: 0 in 0.451s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:13 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 Sep 25 10:55:13 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:13 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8" returned: 0 in 0.295s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ceea988-8e84-4f9f-8a9d-bae7b51a397d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c249aaf-c736-425e-913f-7971b759ede8', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a02d4b-7f58-4a8f-8c7d-d62ae14620ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:13 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Volume volume-5c249aaf-c736-425e-913f-7971b759ede8 (5c249aaf-c736-425e-913f-7971b759ede8): created successfully Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a02d4b-7f58-4a8f-8c7d-d62ae14620ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Flow 'volume_create_manager' (e0ab895c-b807-429f-88bb-45bf736e1b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:13 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-2c03e46d-27b1-4c39-b64f-143826144025 tempest-ProjectReaderTests-1317390258 None] Created volume successfully. Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-09eb5125-812d-4871-b0dd-e5a37df62a9f-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-09eb5125-812d-4871-b0dd-e5a37df62a9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-09eb5125-812d-4871-b0dd-e5a37df62a9f" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-09eb5125-812d-4871-b0dd-e5a37df62a9f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Deleting offline snapshot 09eb5125-812d-4871-b0dd-e5a37df62a9f of volume 0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] snapshot_file for this snap is: volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b5cb32-5f98-4399-98d4-f7c1999d37ea]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:13 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:14 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f Sep 25 10:55:14 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:14 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f" returned: 0 in 0.383s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a322a4-404b-4087-a027-20c0a6b192f0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:14 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 Sep 25 10:55:14 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:14 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" returned: 0 in 0.428s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:14 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f Sep 25 10:55:14 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Creating offline snapshot 9a5184dc-f8fb-4606-92bf-e6442d00aa90 of volume 5c249aaf-c736-425e-913f-7971b759ede8 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daea0f7-6028-4cd4-aee0-d938747ce3dc]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:14 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:15 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 Sep 25 10:55:15 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:15 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f" returned: 0 in 0.462s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:15 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f Sep 25 10:55:15 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:15 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8" returned: 0 in 0.425s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:15 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 1G Sep 25 10:55:15 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:15 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8.09eb5125-812d-4871-b0dd-e5a37df62a9f" returned: 0 in 0.289s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-09eb5125-812d-4871-b0dd-e5a37df62a9f" released by "_delete_snapshot" :: held 1.685s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" released by "delete_snapshot" :: held 1.712s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Created reservations ['ad4bf1c6-efad-40f9-98ed-7f9c66309ebe', 'd642058f-aa76-4eba-b070-4772d754444b', '5307d4b1-2742-4c92-9852-b24236b7f5e0', '53d6320f-3600-4692-91e5-d48002763b1b'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:15 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Delete snapshot completed successfully. Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-9c2bf3a8-e826-43ea-b1c1-2ea6f55bf002 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-09eb5125-812d-4871-b0dd-e5a37df62a9f-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:15 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 1G" returned: 0 in 0.528s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:15 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c249aaf-c736-425e-913f-7971b759ede8 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:15 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c249aaf-c736-425e-913f-7971b759ede8 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 Sep 25 10:55:15 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Lock "cinder-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" acquired by "delete_volume" :: waited 0.015s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a782b12-e74f-46df-bca4-9731f639f41c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:16 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 Sep 25 10:55:16 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:16 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c249aaf-c736-425e-913f-7971b759ede8 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90" returned: 0 in 0.394s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:16 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 is being set with open permissions: ugo+rw Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:16 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 Sep 25 10:55:16 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:16 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:16 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" returned: 0 in 0.481s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90" returned: 0 in 0.312s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:16 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8 Sep 25 10:55:16 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:16 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.info Sep 25 10:55:16 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:16 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" returned: 0 in 0.327s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8" released by "delete_volume" :: held 0.908s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:16 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.info" returned: 0 in 0.333s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:16 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.info is being set with open permissions: ugo+rw Sep 25 10:55:16 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:17 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.info Sep 25 10:55:17 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Created reservations ['83189240-00c5-4700-9038-5a95881e4408', '8fb33198-2221-46dc-b2d4-17b175a06015', '80064d7b-b3ed-4cd2-9ded-d43f69107d85', '0ef7c9a8-404f-44a6-a233-608b2cceaec9'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:17 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:17 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:17 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.info" returned: 0 in 0.283s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.393s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-21fa3f13-00ae-49c5-b3b4-a17585b156c7 tempest-ProjectReaderTests-1317390258 None] Create snapshot completed successfully Sep 25 10:55:17 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.349s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:17 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Deleted volume successfully. Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-f57b8e45-6b5e-4917-a373-a5fe4da4168d tempest-ProjectMemberTests-1442491369 None] Lock "cinder-0f4b1c5f-429c-4a48-9541-d8aa4f469bb8-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (35789695-b645-48d8-b855-91cba358a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f4cd3f-b102-4a5b-8e90-f58852ca2dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f4cd3f-b102-4a5b-8e90-f58852ca2dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129964046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c61e6a-2cdd-4f69-84bd-712e492ca089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:18Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1192286-db89-4e29-a29c-23275810184b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1192286-db89-4e29-a29c-23275810184b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d85526-de9c-44c6-a36e-ae54efac61c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d85526-de9c-44c6-a36e-ae54efac61c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c61e6a-2cdd-4f69-84bd-712e492ca089', 'volume_name': 'volume-94c61e6a-2cdd-4f69-84bd-712e492ca089', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ca575f-6247-4e7d-a28b-f806af84372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ca575f-6247-4e7d-a28b-f806af84372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95faca9b-8768-4c2d-b560-22730676862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:17 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Volume 94c61e6a-2cdd-4f69-84bd-712e492ca089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c61e6a-2cdd-4f69-84bd-712e492ca089', 'volume_size': 1} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129964046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c61e6a-2cdd-4f69-84bd-712e492ca089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:18Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Creating volume 94c61e6a-2cdd-4f69-84bd-712e492ca089 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:17 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:17 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:17 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 1073741824 Sep 25 10:55:17 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-9a5184dc-f8fb-4606-92bf-e6442d00aa90-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Lock "cinder-9a5184dc-f8fb-4606-92bf-e6442d00aa90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-5c249aaf-c736-425e-913f-7971b759ede8" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-5c249aaf-c736-425e-913f-7971b759ede8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-9a5184dc-f8fb-4606-92bf-e6442d00aa90" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-9a5184dc-f8fb-4606-92bf-e6442d00aa90" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Deleting offline snapshot 9a5184dc-f8fb-4606-92bf-e6442d00aa90 of volume 5c249aaf-c736-425e-913f-7971b759ede8 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] snapshot_file for this snap is: volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d8645c-a4b0-4da7-95ce-4ca2cab24c88]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:18 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 Sep 25 10:55:18 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:18 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 1073741824" returned: 0 in 0.538s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:18 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 Sep 25 10:55:18 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:18 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089" returned: 0 in 0.277s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:18 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90" returned: 0 in 0.514s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c249aaf-c736-425e-913f-7971b759ede8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95faca9b-8768-4c2d-b560-22730676862d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c61e6a-2cdd-4f69-84bd-712e492ca089', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be52e1f-c6c2-4a91-ae57-4483a9e03ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3aa3ab-1654-4c3a-9669-e8fd548d1927]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:18 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Volume volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 (94c61e6a-2cdd-4f69-84bd-712e492ca089): created successfully Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be52e1f-c6c2-4a91-ae57-4483a9e03ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:18 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (35789695-b645-48d8-b855-91cba358a745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:18 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-db8a3f7c-e3ef-4099-832e-716913d157ec tempest-ProjectMemberTests-1442491369 None] Created volume successfully. Sep 25 10:55:18 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 Sep 25 10:55:18 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:19 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8" returned: 0 in 0.464s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:19 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 Sep 25 10:55:19 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:19 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90" returned: 0 in 0.406s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:19 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:19 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90 Sep 25 10:55:19 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:20 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8.9a5184dc-f8fb-4606-92bf-e6442d00aa90" returned: 0 in 0.305s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-9a5184dc-f8fb-4606-92bf-e6442d00aa90" released by "_delete_snapshot" :: held 1.828s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-5c249aaf-c736-425e-913f-7971b759ede8" released by "delete_snapshot" :: held 1.859s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Created reservations ['e55daddd-8332-438e-b355-2bdf9177bc4d', 'f8ccf19b-b244-4d3a-9734-25e31ceddc73', '1005ff2d-25cc-4bab-a0ec-1cb397245cbd', '2124b167-b7a6-4ce1-9888-feb3c96ea2bd'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Creating offline snapshot df708431-1c6f-4c2a-890d-1fc5a0dc129a of volume 94c61e6a-2cdd-4f69-84bd-712e492ca089 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b1f20-b9d6-47bb-bcc1-82848bded613]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:20 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Delete snapshot completed successfully. Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cbeca005-0053-4a2e-acf4-c8ccfffb65cb tempest-ProjectReaderTests-1317390258 None] Lock "cinder-9a5184dc-f8fb-4606-92bf-e6442d00aa90-delete_snapshot" released by "delete_snapshot" :: held 2.081s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:20 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 Sep 25 10:55:20 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-5c249aaf-c736-425e-913f-7971b759ede8-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-5c249aaf-c736-425e-913f-7971b759ede8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-5c249aaf-c736-425e-913f-7971b759ede8" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-5c249aaf-c736-425e-913f-7971b759ede8" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[91748a65-92ea-4be9-8c78-55da93671396]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:20 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089" returned: 0 in 0.437s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:20 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 Sep 25 10:55:20 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:20 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a 1G Sep 25 10:55:20 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:20 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8" returned: 0 in 0.431s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:20 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:21 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8 Sep 25 10:55:21 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:21 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a 1G" returned: 0 in 0.538s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:21 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a Sep 25 10:55:21 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:21 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-5c249aaf-c736-425e-913f-7971b759ede8" returned: 0 in 0.311s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-5c249aaf-c736-425e-913f-7971b759ede8" released by "delete_volume" :: held 0.830s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Created reservations ['c660d25a-524d-42c7-b31e-887e9bd04d89', 'ad3ba357-65f9-4427-a93a-15532a03fd00', '38fe78f9-2361-4e41-aaa5-b06b57a75041', '16f7efb4-fd8c-4061-abc6-21c0ef5d4e40'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:21 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:21 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:21 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a" returned: 0 in 0.410s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:21 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a is being set with open permissions: ugo+rw Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:21 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a Sep 25 10:55:21 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:21 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.328s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:21 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Deleted volume successfully. Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b3e73716-b793-489e-ba2e-f68c0e78f049 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-5c249aaf-c736-425e-913f-7971b759ede8-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:21 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:21 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a" returned: 0 in 0.362s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:22 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.info Sep 25 10:55:22 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Flow 'volume_create_manager' (95a0db84-b89e-41b3-901d-1b7ba3bc92d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb6cb1a-acbf-4cae-ad5b-4df2d59dbe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb6cb1a-acbf-4cae-ad5b-4df2d59dbe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804374084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a832cfe-8258-4f1a-a721-5552b87d4c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ccd728024f148fb11ed8539cfe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:22Z,use_quota=True,user_id='fd56553ef074402487a7f8847e0ab3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae97088f-ec6e-4742-8abd-372c34d0f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae97088f-ec6e-4742-8abd-372c34d0f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6964ce90-b148-472e-86dc-8411ea556c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6964ce90-b148-472e-86dc-8411ea556c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a832cfe-8258-4f1a-a721-5552b87d4c5f', 'volume_name': 'volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383c7b91-e3aa-47a7-be6b-cf57ea130deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383c7b91-e3aa-47a7-be6b-cf57ea130deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e4a39c-1bae-456c-8b25-591397b00253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:22 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Volume 2a832cfe-8258-4f1a-a721-5552b87d4c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f', 'volume_size': 1} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:22 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.info" returned: 0 in 0.360s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:22 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.info is being set with open permissions: ugo+rw Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:22 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.info Sep 25 10:55:22 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:22 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.info" returned: 0 in 0.258s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804374084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a832cfe-8258-4f1a-a721-5552b87d4c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ccd728024f148fb11ed8539cfe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:22Z,use_quota=True,user_id='fd56553ef074402487a7f8847e0ab3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Creating volume 2a832cfe-8258-4f1a-a721-5552b87d4c5f {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:22 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:22 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:22 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f 1073741824 Sep 25 10:55:22 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:22 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-554ba032-fa28-4616-a3dd-75b387c98a62 tempest-ProjectMemberTests-1442491369 None] Create snapshot completed successfully Sep 25 10:55:23 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f 1073741824" returned: 0 in 0.506s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:23 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f Sep 25 10:55:23 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-df708431-1c6f-4c2a-890d-1fc5a0dc129a-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-df708431-1c6f-4c2a-890d-1fc5a0dc129a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-94c61e6a-2cdd-4f69-84bd-712e492ca089" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-94c61e6a-2cdd-4f69-84bd-712e492ca089" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-df708431-1c6f-4c2a-890d-1fc5a0dc129a" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-df708431-1c6f-4c2a-890d-1fc5a0dc129a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Deleting offline snapshot df708431-1c6f-4c2a-890d-1fc5a0dc129a of volume 94c61e6a-2cdd-4f69-84bd-712e492ca089 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] snapshot_file for this snap is: volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b6ff9-fa9c-47e5-a40f-feac24678715]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:23 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f" returned: 0 in 0.338s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e4a39c-1bae-456c-8b25-591397b00253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59344fe8-11cd-4ede-a028-531d100c3106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:23 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Volume volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f (2a832cfe-8258-4f1a-a721-5552b87d4c5f): created successfully Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59344fe8-11cd-4ede-a028-531d100c3106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Flow 'volume_create_manager' (95a0db84-b89e-41b3-901d-1b7ba3bc92d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:23 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1b05a918-8fef-4723-a283-67d1b6d735f0 tempest-ProjectReaderTests-1317390258 None] Created volume successfully. Sep 25 10:55:23 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a Sep 25 10:55:23 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:23 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a" returned: 0 in 0.449s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94c61e6a-2cdd-4f69-84bd-712e492ca089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:23 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ba8a7d-cc36-4cf2-bc8a-1f138fb12009]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:24 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 Sep 25 10:55:24 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:24 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089" returned: 0 in 0.568s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:24 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a Sep 25 10:55:24 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:24 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Creating offline snapshot 491fa542-68a0-49d1-a8dc-cd5ae961a2b6 of volume 2a832cfe-8258-4f1a-a721-5552b87d4c5f {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:24 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b15943-2e3b-4aa3-b507-68d59cfdff9d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:24 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:24 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f Sep 25 10:55:24 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:25 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a" returned: 0 in 0.438s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:25 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f" returned: 0 in 0.403s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:25 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a Sep 25 10:55:25 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:25 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 1G Sep 25 10:55:25 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:25 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089.df708431-1c6f-4c2a-890d-1fc5a0dc129a" returned: 0 in 0.260s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-df708431-1c6f-4c2a-890d-1fc5a0dc129a" released by "_delete_snapshot" :: held 1.839s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-94c61e6a-2cdd-4f69-84bd-712e492ca089" released by "delete_snapshot" :: held 1.873s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Created reservations ['1939ab2a-c272-4918-a0f4-c5276e3f4ad0', '45dfc6d5-f5de-43af-9556-746f6a2b2e7f', 'eed0edcf-820b-413f-92cd-4e9007162ae0', '72c0926a-ce24-45d3-a170-2a79f1cde169'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:25 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Delete snapshot completed successfully. Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-95c5e201-685d-4b7c-a02d-b5d60dbfd795 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-df708431-1c6f-4c2a-890d-1fc5a0dc129a-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:25 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 1G" returned: 0 in 0.532s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:25 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 Sep 25 10:55:25 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-94c61e6a-2cdd-4f69-84bd-712e492ca089-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Lock "cinder-94c61e6a-2cdd-4f69-84bd-712e492ca089-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-94c61e6a-2cdd-4f69-84bd-712e492ca089" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-94c61e6a-2cdd-4f69-84bd-712e492ca089" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9019c74d-af83-49c8-99c9-acba9c38d9a8]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:25 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6" returned: 0 in 0.341s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:25 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 is being set with open permissions: ugo+rw Sep 25 10:55:25 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 Sep 25 10:55:25 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:25 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:25 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 Sep 25 10:55:25 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:26 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089" returned: 0 in 0.441s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:26 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6" returned: 0 in 0.315s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:26 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089 Sep 25 10:55:26 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:26 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.info Sep 25 10:55:26 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:26 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-94c61e6a-2cdd-4f69-84bd-712e492ca089" returned: 0 in 0.290s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-94c61e6a-2cdd-4f69-84bd-712e492ca089" released by "delete_volume" :: held 0.825s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:26 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.info" returned: 0 in 0.326s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:26 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.info is being set with open permissions: ugo+rw Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:26 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.info Sep 25 10:55:26 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Created reservations ['7b73ea9d-414e-4aae-bbde-09900c233d95', '46316383-299c-4a47-a783-2eaa76c6f3d4', '4cfc2091-bc6a-425c-a8e9-2fbe54343e4f', '0fc1ee59-cde8-4648-b5b0-8b408822a297'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:26 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:26 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:26 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.info" returned: 0 in 0.341s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:26 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:26 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-5fae9af6-36d8-42b0-b49f-3ae489299212 tempest-ProjectReaderTests-1317390258 None] Create snapshot completed successfully Sep 25 10:55:27 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.367s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:27 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Deleted volume successfully. Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-74e8b67a-74e6-4df1-bf9d-0c94fcb1e9cb tempest-ProjectMemberTests-1442491369 None] Lock "cinder-94c61e6a-2cdd-4f69-84bd-712e492ca089-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (e32697c2-7acd-4264-a103-0bfdbbed050c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c07e30-4bae-4781-aca4-6678e69d7089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c07e30-4bae-4781-aca4-6678e69d7089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329708131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:27Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7cda0a-03e3-4dc7-81ab-418048516a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7cda0a-03e3-4dc7-81ab-418048516a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec995e7-953e-417c-9670-17901a834006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec995e7-953e-417c-9670-17901a834006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb', 'volume_name': 'volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46702b56-7905-4e8f-9f3f-009d9f2e54d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46702b56-7905-4e8f-9f3f-009d9f2e54d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3682d83-7ac3-4a90-841b-a2034d0cc741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:27 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Volume 28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb', 'volume_size': 1} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329708131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:27Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Creating volume 28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:27 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:27 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb 1073741824 Sep 25 10:55:27 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-491fa542-68a0-49d1-a8dc-cd5ae961a2b6-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-491fa542-68a0-49d1-a8dc-cd5ae961a2b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-2a832cfe-8258-4f1a-a721-5552b87d4c5f" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-2a832cfe-8258-4f1a-a721-5552b87d4c5f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-491fa542-68a0-49d1-a8dc-cd5ae961a2b6" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-491fa542-68a0-49d1-a8dc-cd5ae961a2b6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Deleting offline snapshot 491fa542-68a0-49d1-a8dc-cd5ae961a2b6 of volume 2a832cfe-8258-4f1a-a721-5552b87d4c5f {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] snapshot_file for this snap is: volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5209b017-87b0-4d00-a3d8-719f09e2bd4d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:27 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:28 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 Sep 25 10:55:28 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:28 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb 1073741824" returned: 0 in 0.623s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:28 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb Sep 25 10:55:28 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:28 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6" returned: 0 in 0.580s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8726c897-c157-49b5-8d30-96f97ea451ac]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:28 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" returned: 0 in 0.402s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3682d83-7ac3-4a90-841b-a2034d0cc741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f29317e-1c20-4628-9091-e723a5b7a79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:28 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Volume volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb (28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb): created successfully Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f29317e-1c20-4628-9091-e723a5b7a79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:28 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (e32697c2-7acd-4264-a103-0bfdbbed050c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:28 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f46f8b47-349a-40d3-b021-6dc9afd3fd6b tempest-ProjectMemberTests-1442491369 None] Created volume successfully. Sep 25 10:55:28 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f Sep 25 10:55:28 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:29 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f" returned: 0 in 0.461s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:29 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 Sep 25 10:55:29 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:29 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6" returned: 0 in 0.481s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:29 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6 Sep 25 10:55:29 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:29 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f.491fa542-68a0-49d1-a8dc-cd5ae961a2b6" returned: 0 in 0.393s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:29 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-491fa542-68a0-49d1-a8dc-cd5ae961a2b6" released by "_delete_snapshot" :: held 2.089s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:29 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-2a832cfe-8258-4f1a-a721-5552b87d4c5f" released by "delete_snapshot" :: held 2.129s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:29 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Creating offline snapshot 14ed8069-9db7-461a-ab5e-fa5617d94c7b of volume 28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:30 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181cbbb-a4af-4144-a437-5e3ef8269a10]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:30 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=205,cinder:INSERT=60,cinder:UPDATE=234,cinder:DELETE=23 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:55:30 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=238,cinder:SELECT=159,cinder:DELETE=18,cinder:INSERT=71 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:55:30 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Created reservations ['7a4258e9-6eb4-465f-b426-d984e384e9a8', 'ffa0461d-568d-4bf9-90d9-a7943705ba0d', '248d2559-5ec5-4ded-ab3c-05e00e929c11', 'affbad27-b6cf-4fc4-84af-5e4b2b79b7af'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:30 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb Sep 25 10:55:30 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:30 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Delete snapshot completed successfully. Sep 25 10:55:30 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-71a0f486-e936-4258-951f-840a24dba604 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-491fa542-68a0-49d1-a8dc-cd5ae961a2b6-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:30 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" returned: 0 in 0.535s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:30 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:30 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b 1G Sep 25 10:55:30 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-2a832cfe-8258-4f1a-a721-5552b87d4c5f-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-2a832cfe-8258-4f1a-a721-5552b87d4c5f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:31 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b 1G" returned: 0 in 0.580s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:31 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b Sep 25 10:55:31 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-2a832cfe-8258-4f1a-a721-5552b87d4c5f" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-2a832cfe-8258-4f1a-a721-5552b87d4c5f" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aae4c9-0dd0-459e-9e7c-7a9bb0aca715]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:31 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f Sep 25 10:55:31 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:31 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b" returned: 0 in 0.439s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:31 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b is being set with open permissions: ugo+rw Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:31 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b Sep 25 10:55:31 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:31 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f" returned: 0 in 0.545s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:31 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f Sep 25 10:55:31 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:31 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b" returned: 0 in 0.337s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:31 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:32 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.info Sep 25 10:55:32 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:32 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2a832cfe-8258-4f1a-a721-5552b87d4c5f" returned: 0 in 0.393s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-2a832cfe-8258-4f1a-a721-5552b87d4c5f" released by "delete_volume" :: held 1.049s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:32 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Created reservations ['0071e8c9-335a-46e8-990d-be0c45731254', '38de4fd4-c589-4614-b3c0-3cfee9745c8d', '71b027d8-570f-412d-9846-cc3c5e1b8a06', '066b0158-a19e-4a0b-a593-e0ad14d804cb'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.info" returned: 0 in 0.424s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:32 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.info is being set with open permissions: ugo+rw Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:32 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.info Sep 25 10:55:32 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:32 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:32 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:32 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.info" returned: 0 in 0.383s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.851s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:32 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-316283cf-0725-4699-979e-4aae62f005d9 tempest-ProjectMemberTests-1442491369 None] Create snapshot completed successfully Sep 25 10:55:32 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.384s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:32 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Deleted volume successfully. Sep 25 10:55:32 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4f87f4b1-273c-4282-a33e-84ec1a373b11 tempest-ProjectReaderTests-1317390258 None] Lock "cinder-2a832cfe-8258-4f1a-a721-5552b87d4c5f-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-14ed8069-9db7-461a-ab5e-fa5617d94c7b-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-14ed8069-9db7-461a-ab5e-fa5617d94c7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-14ed8069-9db7-461a-ab5e-fa5617d94c7b" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-14ed8069-9db7-461a-ab5e-fa5617d94c7b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Deleting offline snapshot 14ed8069-9db7-461a-ab5e-fa5617d94c7b of volume 28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] snapshot_file for this snap is: volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb9cd8-9047-4b90-a7db-f5435455e1ef]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:33 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b Sep 25 10:55:33 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:33 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b" returned: 0 in 0.499s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d3fbec-b57a-4c94-9d36-4885f2edd07e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:33 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:33 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb Sep 25 10:55:33 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Flow 'volume_create_manager' (af5b5a6f-c7af-4cc2-9ed3-a612d350eba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d2e100-2213-4dde-980b-7854670fe118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d2e100-2213-4dde-980b-7854670fe118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039306927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16223fbc-285d-4ee2-93af-07776082a345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ccd728024f148fb11ed8539cfe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:34Z,use_quota=True,user_id='fd56553ef074402487a7f8847e0ab3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45aa1ebb-ecd5-4046-be3d-5baeba7a7fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45aa1ebb-ecd5-4046-be3d-5baeba7a7fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8cd5ea-bf0e-4f16-9060-99e00525d4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8cd5ea-bf0e-4f16-9060-99e00525d4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16223fbc-285d-4ee2-93af-07776082a345', 'volume_name': 'volume-16223fbc-285d-4ee2-93af-07776082a345', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a13eed-acfd-44df-adad-f296735c5ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a13eed-acfd-44df-adad-f296735c5ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ec5658-fdb7-458d-b316-333e1a51a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:34 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Volume 16223fbc-285d-4ee2-93af-07776082a345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16223fbc-285d-4ee2-93af-07776082a345', 'volume_size': 1} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039306927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16223fbc-285d-4ee2-93af-07776082a345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ccd728024f148fb11ed8539cfe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:34Z,use_quota=True,user_id='fd56553ef074402487a7f8847e0ab3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Creating volume 16223fbc-285d-4ee2-93af-07776082a345 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:34 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:34 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 1073741824 Sep 25 10:55:34 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:34 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" returned: 0 in 0.514s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:34 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b Sep 25 10:55:34 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:34 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b" returned: 0 in 0.415s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:34 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b Sep 25 10:55:34 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:34 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 1073741824" returned: 0 in 0.570s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:34 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:34 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 Sep 25 10:55:34 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:35 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb.14ed8069-9db7-461a-ab5e-fa5617d94c7b" returned: 0 in 0.329s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-14ed8069-9db7-461a-ab5e-fa5617d94c7b" released by "_delete_snapshot" :: held 1.910s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" released by "delete_snapshot" :: held 1.939s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:35 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Created reservations ['9fe7fef1-0bc4-4c99-9995-cc5f403dc6e7', '33b8e41a-5f04-419e-a07d-d3c099f54c8a', 'd0b08ce0-3ced-4483-ba9d-0db5d5330116', '4f28b804-c798-4c86-91af-39e9494a5327'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345" returned: 0 in 0.335s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ec5658-fdb7-458d-b316-333e1a51a411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16223fbc-285d-4ee2-93af-07776082a345', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68df25de-ba1a-4c5d-9dda-36366d09a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:35 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Volume volume-16223fbc-285d-4ee2-93af-07776082a345 (16223fbc-285d-4ee2-93af-07776082a345): created successfully Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68df25de-ba1a-4c5d-9dda-36366d09a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Flow 'volume_create_manager' (af5b5a6f-c7af-4cc2-9ed3-a612d350eba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-169442a6-ac12-454a-b0aa-7774ff9890e0 tempest-ProjectReaderTests-1317390258 None] Created volume successfully. Sep 25 10:55:35 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Delete snapshot completed successfully. Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-421c1711-5c7d-455d-a108-a17b0f60f2f6 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-14ed8069-9db7-461a-ab5e-fa5617d94c7b-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" acquired by "delete_volume" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[92743224-d768-47b5-8087-bc4ae6f40a80]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:35 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb Sep 25 10:55:35 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:35 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" returned: 0 in 0.470s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:35 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:35 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb Sep 25 10:55:35 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:36 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" returned: 0 in 0.296s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb" released by "delete_volume" :: held 0.848s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Created reservations ['d9cc38a3-3a9a-4e3e-98e5-e2d35a0d8abe', 'ade8198e-1cb0-4b7b-a9ac-57b427802b96', '71df36c9-85c4-47fa-a384-b1d062bf0208', '9fba697f-8f95-4398-b5d3-a000103cb1a9'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Creating offline snapshot 07a351c2-411b-4a01-86b6-f47be079c3c7 of volume 16223fbc-285d-4ee2-93af-07776082a345 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d85e7a-06e4-4d97-853e-edaae7b037be]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:36 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:36 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:36 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 Sep 25 10:55:36 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:36 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.289s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:36 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Deleted volume successfully. Sep 25 10:55:36 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-66fba124-1135-4f36-aa44-324d83a8a3c8 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-28fc98dc-246b-4fd2-b0ea-ca5bcd16bdbb-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:37 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345" returned: 0 in 0.498s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:37 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 1G Sep 25 10:55:37 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (83a109b7-34cd-4705-9747-4882ccafc903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66af4f58-6a05-4294-b415-9cc3da0f4bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66af4f58-6a05-4294-b415-9cc3da0f4bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822023375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c053643-6c6b-44c2-a8bc-f571ad64f975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:37Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425d3d3c-4f97-4042-a2a0-2394ec7c58d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425d3d3c-4f97-4042-a2a0-2394ec7c58d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1728dc4-d6fb-4ecb-a832-15c14aae1271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1728dc4-d6fb-4ecb-a832-15c14aae1271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c053643-6c6b-44c2-a8bc-f571ad64f975', 'volume_name': 'volume-9c053643-6c6b-44c2-a8bc-f571ad64f975', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6287e1-fa1c-44ee-8f0a-1c339098980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6287e1-fa1c-44ee-8f0a-1c339098980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859b43dc-9b09-4414-9d09-d890c2b892ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:37 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Volume 9c053643-6c6b-44c2-a8bc-f571ad64f975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c053643-6c6b-44c2-a8bc-f571ad64f975', 'volume_size': 1} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:37 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 1G" returned: 0 in 0.530s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16223fbc-285d-4ee2-93af-07776082a345 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:37 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16223fbc-285d-4ee2-93af-07776082a345 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 Sep 25 10:55:37 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:37 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16223fbc-285d-4ee2-93af-07776082a345 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7" returned: 0 in 0.382s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:37 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 is being set with open permissions: ugo+rw Sep 25 10:55:37 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:37 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 Sep 25 10:55:37 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:38 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7" returned: 0 in 0.291s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:38 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.info Sep 25 10:55:38 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:38 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.info" returned: 0 in 0.332s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:38 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.info is being set with open permissions: ugo+rw Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:38 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.info Sep 25 10:55:38 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:38 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.info" returned: 0 in 0.329s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.682s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822023375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c053643-6c6b-44c2-a8bc-f571ad64f975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:37Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Creating volume 9c053643-6c6b-44c2-a8bc-f571ad64f975 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:38 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:38 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:38 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 1073741824 Sep 25 10:55:38 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:38 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-d42148a1-5c16-437b-b548-8516801221be tempest-ProjectReaderTests-1317390258 None] Create snapshot completed successfully Sep 25 10:55:39 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 1073741824" returned: 0 in 0.507s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:39 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 Sep 25 10:55:39 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-07a351c2-411b-4a01-86b6-f47be079c3c7-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Lock "cinder-07a351c2-411b-4a01-86b6-f47be079c3c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-16223fbc-285d-4ee2-93af-07776082a345" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-16223fbc-285d-4ee2-93af-07776082a345" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-07a351c2-411b-4a01-86b6-f47be079c3c7" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-07a351c2-411b-4a01-86b6-f47be079c3c7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Deleting offline snapshot 07a351c2-411b-4a01-86b6-f47be079c3c7 of volume 16223fbc-285d-4ee2-93af-07776082a345 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] snapshot_file for this snap is: volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d060d9f2-b9a5-4de3-9833-6adbfeedb8a0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:39 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975" returned: 0 in 0.333s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859b43dc-9b09-4414-9d09-d890c2b892ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c053643-6c6b-44c2-a8bc-f571ad64f975', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047375d1-30cf-431f-9476-7543e2d964e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:39 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Volume volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 (9c053643-6c6b-44c2-a8bc-f571ad64f975): created successfully Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047375d1-30cf-431f-9476-7543e2d964e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:39 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 Sep 25 10:55:39 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:39 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (83a109b7-34cd-4705-9747-4882ccafc903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:39 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-ac71f203-0765-4226-a61e-6b3cdb6df6ba tempest-ProjectMemberTests-1442491369 None] Created volume successfully. Sep 25 10:55:40 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7" returned: 0 in 0.447s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16223fbc-285d-4ee2-93af-07776082a345(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaaa8f4-2a0f-4a9d-aa20-6cb92c6f83ec]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:40 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 Sep 25 10:55:40 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Creating offline snapshot 02b16e7b-0a4e-4501-9381-8cd68264d627 of volume 9c053643-6c6b-44c2-a8bc-f571ad64f975 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c91e0c-ce40-48ed-9752-f09567d8437d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:40 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345" returned: 0 in 0.492s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:40 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:40 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 Sep 25 10:55:40 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:40 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 Sep 25 10:55:40 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:41 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975" returned: 0 in 0.467s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:41 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7" returned: 0 in 0.413s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:41 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 1G Sep 25 10:55:41 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:41 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7 Sep 25 10:55:41 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:41 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345.07a351c2-411b-4a01-86b6-f47be079c3c7" returned: 0 in 0.297s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-07a351c2-411b-4a01-86b6-f47be079c3c7" released by "_delete_snapshot" :: held 1.780s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-16223fbc-285d-4ee2-93af-07776082a345" released by "delete_snapshot" :: held 1.808s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Created reservations ['3c631b10-be8e-4178-8953-e97c9613dc58', 'e0ce20e3-086b-4da0-8883-4b19c11c0a29', '37955d72-9ec3-480b-ae89-812553dc9653', '44790793-72aa-4581-adeb-6f802807e4df'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:41 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 1G" returned: 0 in 0.517s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:41 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Delete snapshot completed successfully. Sep 25 10:55:41 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 Sep 25 10:55:41 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-011c2e60-cb49-4dd9-8d31-c7cf1af89dde tempest-ProjectReaderTests-1317390258 None] Lock "cinder-07a351c2-411b-4a01-86b6-f47be079c3c7-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-16223fbc-285d-4ee2-93af-07776082a345-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Lock "cinder-16223fbc-285d-4ee2-93af-07776082a345-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-16223fbc-285d-4ee2-93af-07776082a345" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-16223fbc-285d-4ee2-93af-07776082a345" acquired by "delete_volume" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:41 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[597fb76f-2b5b-491a-9913-fe1daae11bb0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627" returned: 0 in 0.426s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:42 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 is being set with open permissions: ugo+rw Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 Sep 25 10:55:42 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:42 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 Sep 25 10:55:42 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:42 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627" returned: 0 in 0.270s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.info Sep 25 10:55:42 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:42 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345" returned: 0 in 0.432s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345 Sep 25 10:55:42 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:42 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.info" returned: 0 in 0.322s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:42 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.info is being set with open permissions: ugo+rw Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-16223fbc-285d-4ee2-93af-07776082a345" returned: 0 in 0.284s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:42 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.info Sep 25 10:55:42 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-16223fbc-285d-4ee2-93af-07776082a345" released by "delete_volume" :: held 0.801s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Created reservations ['9fbd834e-3ceb-4a81-b436-e41ed5d0325c', 'a1497422-e5a8-4d60-9fe2-d986a52fe827', '19fcd3ee-d0bd-4e46-850d-37c2c9c406f1', '1fb09f2f-ef78-4751-9e18-3f20004b5d8d'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:42 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:42 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:42 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:43 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.info" returned: 0 in 0.324s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:43 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-e0db92b5-e9cc-4015-9d04-90f1ec3eca97 tempest-ProjectMemberTests-1442491369 None] Create snapshot completed successfully Sep 25 10:55:43 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.322s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:43 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Deleted volume successfully. Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3c08f74b-fbc4-4e3d-a16c-2daebb9b5eba tempest-ProjectReaderTests-1317390258 None] Lock "cinder-16223fbc-285d-4ee2-93af-07776082a345-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Flow 'volume_create_manager' (015563d2-ccb5-49e0-a4a8-636833b51477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059e6a7b-b6ca-4c95-b05f-e0d41b830c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059e6a7b-b6ca-4c95-b05f-e0d41b830c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-400944995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef053fb-533f-4840-82dc-0f0b4ada643b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ccd728024f148fb11ed8539cfe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:44Z,use_quota=True,user_id='fd56553ef074402487a7f8847e0ab3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3298f2-4847-4ad5-bab3-4cc3adee0b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3298f2-4847-4ad5-bab3-4cc3adee0b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3518e90d-1042-4d93-9636-812ca846411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3518e90d-1042-4d93-9636-812ca846411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef053fb-533f-4840-82dc-0f0b4ada643b', 'volume_name': 'volume-0ef053fb-533f-4840-82dc-0f0b4ada643b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac71dae-40e5-4d0e-a783-35950045cc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac71dae-40e5-4d0e-a783-35950045cc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2b356e-d862-44a4-baa7-bf773209fc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:43 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Volume 0ef053fb-533f-4840-82dc-0f0b4ada643b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef053fb-533f-4840-82dc-0f0b4ada643b', 'volume_size': 1} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-400944995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef053fb-533f-4840-82dc-0f0b4ada643b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ccd728024f148fb11ed8539cfe45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:44Z,use_quota=True,user_id='fd56553ef074402487a7f8847e0ab3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Creating volume 0ef053fb-533f-4840-82dc-0f0b4ada643b {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:43 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:43 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b 1073741824 Sep 25 10:55:43 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-02b16e7b-0a4e-4501-9381-8cd68264d627-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Lock "cinder-02b16e7b-0a4e-4501-9381-8cd68264d627-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-9c053643-6c6b-44c2-a8bc-f571ad64f975" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-9c053643-6c6b-44c2-a8bc-f571ad64f975" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-02b16e7b-0a4e-4501-9381-8cd68264d627" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-02b16e7b-0a4e-4501-9381-8cd68264d627" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Deleting offline snapshot 02b16e7b-0a4e-4501-9381-8cd68264d627 of volume 9c053643-6c6b-44c2-a8bc-f571ad64f975 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] snapshot_file for this snap is: volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d7d267-127e-4c55-b9ad-de4963374ec2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:43 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:44 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 Sep 25 10:55:44 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:44 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b 1073741824" returned: 0 in 0.562s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:44 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b Sep 25 10:55:44 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:44 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627" returned: 0 in 0.489s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c053643-6c6b-44c2-a8bc-f571ad64f975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f628eee3-70bf-4325-845c-17b1f8b90231]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:44 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b" returned: 0 in 0.356s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:44 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 Sep 25 10:55:44 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2b356e-d862-44a4-baa7-bf773209fc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef053fb-533f-4840-82dc-0f0b4ada643b', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7adb8289-9bc6-4d83-bb0c-2ab1818579aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:44 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Volume volume-0ef053fb-533f-4840-82dc-0f0b4ada643b (0ef053fb-533f-4840-82dc-0f0b4ada643b): created successfully Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7adb8289-9bc6-4d83-bb0c-2ab1818579aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:44 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Flow 'volume_create_manager' (015563d2-ccb5-49e0-a4a8-636833b51477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:44 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-db01318c-a599-4714-8198-b2bb253f9af8 tempest-ProjectReaderTests-1317390258 None] Created volume successfully. Sep 25 10:55:45 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975" returned: 0 in 0.507s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:45 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 Sep 25 10:55:45 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:45 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627" returned: 0 in 0.394s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:45 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627 Sep 25 10:55:45 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:45 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975.02b16e7b-0a4e-4501-9381-8cd68264d627" returned: 0 in 0.306s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-02b16e7b-0a4e-4501-9381-8cd68264d627" released by "_delete_snapshot" :: held 1.854s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-9c053643-6c6b-44c2-a8bc-f571ad64f975" released by "delete_snapshot" :: held 1.887s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Created reservations ['424a9b07-2cc7-46ce-8d1b-48d7befb2e4c', 'a9f59072-06e4-4058-86bc-7c49d1f4ec6c', '44b80e10-6e43-4b4f-b525-431fe3ce7f25', 'ef88fa7e-bebc-4bf6-87cc-971f09c662c2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Creating offline snapshot b85d7862-21b3-4035-98c8-177ef079f40e of volume 0ef053fb-533f-4840-82dc-0f0b4ada643b {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:45 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Delete snapshot completed successfully. Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-7e54f6c4-c00f-4745-a29b-e339cab4e3fd tempest-ProjectMemberTests-1442491369 None] Lock "cinder-02b16e7b-0a4e-4501-9381-8cd68264d627-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[466dddf0-1db9-451e-9cdc-959623cb29be]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:45 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-9c053643-6c6b-44c2-a8bc-f571ad64f975-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Lock "cinder-9c053643-6c6b-44c2-a8bc-f571ad64f975-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-9c053643-6c6b-44c2-a8bc-f571ad64f975" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:46 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b Sep 25 10:55:46 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:46 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-9c053643-6c6b-44c2-a8bc-f571ad64f975" acquired by "delete_volume" :: waited 0.038s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:46 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4121b157-dd3b-4403-b076-52252ec6bca7]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:46 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 Sep 25 10:55:46 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:46 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b" returned: 0 in 0.451s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:46 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e 1G Sep 25 10:55:46 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:46 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975" returned: 0 in 0.445s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:46 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:46 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975 Sep 25 10:55:46 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:47 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e 1G" returned: 0 in 0.562s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef053fb-533f-4840-82dc-0f0b4ada643b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:47 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9c053643-6c6b-44c2-a8bc-f571ad64f975" returned: 0 in 0.347s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:47 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef053fb-533f-4840-82dc-0f0b4ada643b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e Sep 25 10:55:47 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-9c053643-6c6b-44c2-a8bc-f571ad64f975" released by "delete_volume" :: held 0.882s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Created reservations ['da3ceba6-9f54-4f99-ba3e-ff8dc353825a', 'bd482be6-1c59-4a00-afd1-f2ed2406f372', '6203f264-aa9d-4eb5-96c7-125df0930b9d', '4178cc40-1e89-453e-be6d-ef3c393cc05c'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:47 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:47 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:47 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef053fb-533f-4840-82dc-0f0b4ada643b -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e" returned: 0 in 0.477s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:47 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e is being set with open permissions: ugo+rw Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:47 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e Sep 25 10:55:47 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:47 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.411s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:47 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Deleted volume successfully. Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-279d6f5f-8baf-4aae-9dff-d64e8901369b tempest-ProjectMemberTests-1442491369 None] Lock "cinder-9c053643-6c6b-44c2-a8bc-f571ad64f975-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:47 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e" returned: 0 in 0.345s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:47 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.info Sep 25 10:55:47 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (bd9ffc02-804b-4cd0-98cc-ea2f0dd701cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b84e0e7-34e0-4546-b982-8b2e13fca92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b84e0e7-34e0-4546-b982-8b2e13fca92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:48Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2101d212-d5f9-4fa0-89b6-505976e5c30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2101d212-d5f9-4fa0-89b6-505976e5c30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade496e1-dced-4b9f-a642-e51e989ba70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade496e1-dced-4b9f-a642-e51e989ba70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0', 'volume_name': 'volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e63ea88-3a90-4482-83af-146ec1280c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e63ea88-3a90-4482-83af-146ec1280c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153f906d-7c93-43c2-b1b2-ee66ddcd0280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:48 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Volume 3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0', 'volume_size': 1} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:48 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.info" returned: 0 in 0.322s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:48 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.info is being set with open permissions: ugo+rw Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:48 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.info Sep 25 10:55:48 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:48 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.info" returned: 0 in 0.282s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:48Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Creating volume 3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:48 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:48 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 1073741824 Sep 25 10:55:48 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:48 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-f2331639-65aa-45b3-9e11-5a75ed4e4ef6 tempest-ProjectReaderTests-1317390258 None] Create snapshot completed successfully Sep 25 10:55:49 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 1073741824" returned: 0 in 0.523s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-b85d7862-21b3-4035-98c8-177ef079f40e-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:49 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Lock "cinder-b85d7862-21b3-4035-98c8-177ef079f40e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:49 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-0ef053fb-533f-4840-82dc-0f0b4ada643b" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-0ef053fb-533f-4840-82dc-0f0b4ada643b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-b85d7862-21b3-4035-98c8-177ef079f40e" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-b85d7862-21b3-4035-98c8-177ef079f40e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Deleting offline snapshot b85d7862-21b3-4035-98c8-177ef079f40e of volume 0ef053fb-533f-4840-82dc-0f0b4ada643b {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] snapshot_file for this snap is: volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d8bd6a-111a-4266-80d4-de6c93ecab82]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:49 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e Sep 25 10:55:49 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:49 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" returned: 0 in 0.294s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153f906d-7c93-43c2-b1b2-ee66ddcd0280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da66baa7-084f-4186-a2ac-8803198c0d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:49 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Volume volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 (3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0): created successfully Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da66baa7-084f-4186-a2ac-8803198c0d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (bd9ffc02-804b-4cd0-98cc-ea2f0dd701cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:49 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1b94a958-fa73-4cb3-98a7-96e0a303b21e tempest-ProjectMemberTests-1442491369 None] Created volume successfully. Sep 25 10:55:49 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e" returned: 0 in 0.405s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ef053fb-533f-4840-82dc-0f0b4ada643b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ed76d6-2919-4e06-9c9d-39cf1e00f31c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:49 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:49 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b Sep 25 10:55:49 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:50 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b" returned: 0 in 0.407s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:50 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e Sep 25 10:55:50 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Creating offline snapshot 80acc0ad-3f68-4101-9651-25def8d4b225 of volume 3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb7fef3-7ee1-4f96-b36b-4f1c9106749c]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:50 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 Sep 25 10:55:50 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:50 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e" returned: 0 in 0.394s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:50 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e Sep 25 10:55:50 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:50 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" returned: 0 in 0.435s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:50 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 1G Sep 25 10:55:50 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:50 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b.b85d7862-21b3-4035-98c8-177ef079f40e" returned: 0 in 0.266s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-b85d7862-21b3-4035-98c8-177ef079f40e" released by "_delete_snapshot" :: held 1.588s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-0ef053fb-533f-4840-82dc-0f0b4ada643b" released by "delete_snapshot" :: held 1.613s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Created reservations ['ee5ad786-2d3e-491e-a99e-9409a343ae45', '79d16646-ad24-46ad-b6a4-e091e4649c0c', 'f0aa28d3-1355-453d-abbb-3e2df0a83d3d', 'acdb700e-683e-4fb8-920f-4a4534878f9e'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:50 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Delete snapshot completed successfully. Sep 25 10:55:50 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-880f0e1b-87cc-47aa-85be-471582fadbac tempest-ProjectReaderTests-1317390258 None] Lock "cinder-b85d7862-21b3-4035-98c8-177ef079f40e-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:51 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 1G" returned: 0 in 0.505s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:51 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 Sep 25 10:55:51 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-0ef053fb-533f-4840-82dc-0f0b4ada643b-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Lock "cinder-0ef053fb-533f-4840-82dc-0f0b4ada643b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Acquiring lock "cinder-quobyte-0ef053fb-533f-4840-82dc-0f0b4ada643b" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-0ef053fb-533f-4840-82dc-0f0b4ada643b" acquired by "delete_volume" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dea1ca6-a8de-4200-8231-2566cbecddee]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:51 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225" returned: 0 in 0.375s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:51 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 is being set with open permissions: ugo+rw Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:51 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 Sep 25 10:55:51 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:51 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b Sep 25 10:55:51 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:51 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225" returned: 0 in 0.276s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:51 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.info Sep 25 10:55:51 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:51 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b" returned: 0 in 0.433s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:51 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b Sep 25 10:55:51 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:52 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-0ef053fb-533f-4840-82dc-0f0b4ada643b" returned: 0 in 0.281s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:52 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.info" returned: 0 in 0.355s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:52 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.info is being set with open permissions: ugo+rw Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Lock "cinder-quobyte-0ef053fb-533f-4840-82dc-0f0b4ada643b" released by "delete_volume" :: held 0.800s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:52 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.info Sep 25 10:55:52 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Created reservations ['da756548-9e2f-4fe9-b9a5-1f3fa5e307b5', 'f3075716-b70e-462f-b2b3-64536b32aaeb', 'f3aea905-b31f-4c94-84a2-5cdc9fdfa883', '4b9337d8-0a3c-4f86-9ac7-6cf538abdd4a'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:52 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:52 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:52 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.info" returned: 0 in 0.308s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.360s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:52 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-17b07f15-84d3-4500-8283-d182ba51941e tempest-ProjectMemberTests-1442491369 None] Create snapshot completed successfully Sep 25 10:55:52 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.332s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:52 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Deleted volume successfully. Sep 25 10:55:52 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-cc3f9666-a81e-45e2-9076-42bfdf3c091c tempest-ProjectReaderTests-1317390258 None] Lock "cinder-0ef053fb-533f-4840-82dc-0f0b4ada643b-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-80acc0ad-3f68-4101-9651-25def8d4b225-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Lock "cinder-80acc0ad-3f68-4101-9651-25def8d4b225-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-80acc0ad-3f68-4101-9651-25def8d4b225" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:53 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-80acc0ad-3f68-4101-9651-25def8d4b225" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Deleting offline snapshot 80acc0ad-3f68-4101-9651-25def8d4b225 of volume 3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:55:53 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] snapshot_file for this snap is: volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:55:53 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ecdf63-4035-45f8-bb2e-8450b9633aeb]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:53 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:53 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 Sep 25 10:55:53 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:53 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225" returned: 0 in 0.513s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:55:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d165d51c-7c99-46b4-8e46-b25565431b4d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:54 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 Sep 25 10:55:54 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:54 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" returned: 0 in 0.469s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:54 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 Sep 25 10:55:54 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:54 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225" returned: 0 in 0.423s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:54 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225 Sep 25 10:55:54 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:55 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0.80acc0ad-3f68-4101-9651-25def8d4b225" returned: 0 in 0.317s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-80acc0ad-3f68-4101-9651-25def8d4b225" released by "_delete_snapshot" :: held 1.866s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" released by "delete_snapshot" :: held 1.896s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Created reservations ['482294d0-f8d5-48d2-9b97-853534d4d85f', '8ef30c6c-9418-486c-ab3a-828f7c532079', '3e7d535d-01dc-4af8-b586-13e64c0fe4a4', 'fe17ab73-09b2-4ae0-8f88-bb563b3021f7'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:55 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Delete snapshot completed successfully. Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-1414c138-efc3-46ec-adcc-6fd3e3cdee7c tempest-ProjectMemberTests-1442491369 None] Lock "cinder-80acc0ad-3f68-4101-9651-25def8d4b225-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7ad5b-9d5d-4f23-8b73-24add60a6bbf]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:55 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 Sep 25 10:55:55 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:56 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" returned: 0 in 0.456s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:56 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0 Sep 25 10:55:56 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:56 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" returned: 0 in 0.273s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0" released by "delete_volume" :: held 0.812s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Created reservations ['d0252115-4b8e-4d27-952e-ec3a06a5b596', '6172ba40-9ba2-443c-afcd-56d8a1f98208', '250c37f0-5042-4d8f-8422-2306e11b5210', '0a3685aa-5f68-4a5f-a7f0-513a2c175b5a'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:56 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:55:56 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:56 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.306s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:56 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:55:57 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Deleted volume successfully. Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4833ef47-cfda-4e60-985f-b5ebc639e7d7 tempest-ProjectMemberTests-1442491369 None] Lock "cinder-3dcb48fa-86ee-4cea-94c5-6c64bb9b7ab0-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (3eb92d83-dcb7-4e62-9f3f-11be84d01ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2516278-fe60-4f0c-a63b-c4d5b092fd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2516278-fe60-4f0c-a63b-c4d5b092fd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632521122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905ed369-4c3f-4b35-9979-51cc18af78de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:58Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055a953f-f37d-4609-839d-4d4b5ad12f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055a953f-f37d-4609-839d-4d4b5ad12f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161d7bfb-4d84-4b1d-82d6-3a4261472b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161d7bfb-4d84-4b1d-82d6-3a4261472b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905ed369-4c3f-4b35-9979-51cc18af78de', 'volume_name': 'volume-905ed369-4c3f-4b35-9979-51cc18af78de', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0ae7c6-d77e-40d2-8905-251858f54975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0ae7c6-d77e-40d2-8905-251858f54975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ad9dcb-0cf1-44d5-99b0-667a4238d668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:57 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Volume 905ed369-4c3f-4b35-9979-51cc18af78de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905ed369-4c3f-4b35-9979-51cc18af78de', 'volume_size': 1} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632521122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905ed369-4c3f-4b35-9979-51cc18af78de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64b88f0415e45b4bbe65530e399a243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:55:58Z,use_quota=True,user_id='4f384ac83e2b429f894c13919d7e3a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Creating volume 905ed369-4c3f-4b35-9979-51cc18af78de {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:55:57 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:55:57 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:57 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de 1073741824 Sep 25 10:55:57 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:58 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de 1073741824" returned: 0 in 0.573s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:58 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de Sep 25 10:55:58 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:55:58 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 25 10:55:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de" returned: 0 in 0.339s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:55:58 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:55:58 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:55:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ad9dcb-0cf1-44d5-99b0-667a4238d668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905ed369-4c3f-4b35-9979-51cc18af78de', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286616d1-842d-4b4e-88a8-bfe7e8b2e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:55:58 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Volume volume-905ed369-4c3f-4b35-9979-51cc18af78de (905ed369-4c3f-4b35-9979-51cc18af78de): created successfully Sep 25 10:55:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286616d1-842d-4b4e-88a8-bfe7e8b2e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:55:58 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Flow 'volume_create_manager' (3eb92d83-dcb7-4e62-9f3f-11be84d01ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:55:58 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-60469800-7bcd-40e7-b663-82480e99e927 tempest-ProjectMemberTests-1442491369 None] Created volume successfully. Sep 25 10:55:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:55:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:55:59 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Creating offline snapshot aa315618-0df9-429c-be9d-2ef5df8e41a4 of volume 905ed369-4c3f-4b35-9979-51cc18af78de {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:55:59 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c21214d-1e7d-4895-89f2-fd502348a141]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:55:59 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:55:59 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de Sep 25 10:55:59 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:00 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de" returned: 0 in 0.384s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:00 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 1G Sep 25 10:56:00 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:00 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 1G" returned: 0 in 0.506s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:00 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905ed369-4c3f-4b35-9979-51cc18af78de -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:00 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905ed369-4c3f-4b35-9979-51cc18af78de -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 Sep 25 10:56:00 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:01 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905ed369-4c3f-4b35-9979-51cc18af78de -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4" returned: 0 in 0.407s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:01 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 is being set with open permissions: ugo+rw Sep 25 10:56:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:01 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 Sep 25 10:56:01 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:01 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4" returned: 0 in 0.353s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:01 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.info Sep 25 10:56:01 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:01 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.info" returned: 0 in 0.307s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:01 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.info is being set with open permissions: ugo+rw Sep 25 10:56:01 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:01 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.info Sep 25 10:56:01 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:02 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.info" returned: 0 in 0.271s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:02 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-659f1083-83e8-4dc8-8325-32ca9dce46ff tempest-ProjectMemberTests-1442491369 None] Create snapshot completed successfully Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-aa315618-0df9-429c-be9d-2ef5df8e41a4-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Lock "cinder-aa315618-0df9-429c-be9d-2ef5df8e41a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-905ed369-4c3f-4b35-9979-51cc18af78de" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-905ed369-4c3f-4b35-9979-51cc18af78de" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-aa315618-0df9-429c-be9d-2ef5df8e41a4" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-aa315618-0df9-429c-be9d-2ef5df8e41a4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Deleting offline snapshot aa315618-0df9-429c-be9d-2ef5df8e41a4 of volume 905ed369-4c3f-4b35-9979-51cc18af78de {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] snapshot_file for this snap is: volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c49ec8f-e6ab-458e-baa0-5e5c5561159e]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:03 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 Sep 25 10:56:03 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:03 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:56:03 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:03 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4" returned: 0 in 0.487s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905ed369-4c3f-4b35-9979-51cc18af78de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:03 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a32f5e3-0a3a-497a-a4e5-dc4b8bc6383a]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.343s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:56:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:56:03 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de Sep 25 10:56:03 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:04 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de" returned: 0 in 0.487s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:04 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 Sep 25 10:56:04 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:04 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4" returned: 0 in 0.454s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:04 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4 Sep 25 10:56:04 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:05 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de.aa315618-0df9-429c-be9d-2ef5df8e41a4" returned: 0 in 0.314s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-aa315618-0df9-429c-be9d-2ef5df8e41a4" released by "_delete_snapshot" :: held 1.896s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-905ed369-4c3f-4b35-9979-51cc18af78de" released by "delete_snapshot" :: held 1.929s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Created reservations ['5303f4d8-1496-4a74-8239-7cada38ebb8f', '7df366dc-76e8-49ab-8e78-b2d07d33fa5f', '93ec7397-f390-4ac3-8f36-660bbb0b0320', '1520233e-9d4f-49a9-a4f6-d6e20cc85377'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:05 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Delete snapshot completed successfully. Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-4091dcae-a101-4fc2-8ba9-78bdeb814abe tempest-ProjectMemberTests-1442491369 None] Lock "cinder-aa315618-0df9-429c-be9d-2ef5df8e41a4-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-905ed369-4c3f-4b35-9979-51cc18af78de-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Lock "cinder-905ed369-4c3f-4b35-9979-51cc18af78de-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Acquiring lock "cinder-quobyte-905ed369-4c3f-4b35-9979-51cc18af78de" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-905ed369-4c3f-4b35-9979-51cc18af78de" acquired by "delete_volume" :: waited 0.021s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[661114ec-e3d0-414a-8c44-2a71f208aa29]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:05 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de Sep 25 10:56:05 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:05 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de" returned: 0 in 0.415s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:06 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de Sep 25 10:56:06 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:06 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-905ed369-4c3f-4b35-9979-51cc18af78de" returned: 0 in 0.283s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Lock "cinder-quobyte-905ed369-4c3f-4b35-9979-51cc18af78de" released by "delete_volume" :: held 0.779s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Created reservations ['7cc7f67f-d355-4114-bf9c-dbdd352e3e61', 'ea45308e-922d-4850-bf9a-a0261f18351e', 'ec7f2488-fbc7-4808-8954-af7aa46dcc19', '3315c458-731c-4de4-bf37-1cb7e82586f2'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:06 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:56:06 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:06 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.328s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:56:06 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Deleted volume successfully. Sep 25 10:56:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-b69c9af9-6f8e-4958-b161-d355345d5aae tempest-ProjectMemberTests-1442491369 None] Lock "cinder-905ed369-4c3f-4b35-9979-51cc18af78de-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:56:16 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:INSERT=33,cinder:UPDATE=121,cinder:SELECT=89,cinder:DELETE=5 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:56:16 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=86,cinder:UPDATE=115,cinder:INSERT=33,cinder:DELETE=13 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:56:45 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:56:45 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:56:47 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:56:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Flow 'volume_create_manager' (81f8e88f-5ba1-4055-a749-ca32cc9df247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25c9cff-27bc-49fb-a50e-e35fcb02c149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25c9cff-27bc-49fb-a50e-e35fcb02c149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-503945638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f005ad6-c30c-4279-8bcf-57ae9209ba04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e9fd73208e4dfe9f1d5471708686ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:48Z,use_quota=True,user_id='35861a3da4f5431b9eb9e4e8a25f29d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4300b0bb-c4fe-4225-9bdf-4181c25b0d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4300b0bb-c4fe-4225-9bdf-4181c25b0d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a395e460-1a41-4aa3-a7f6-b3a5510eff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:47 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a395e460-1a41-4aa3-a7f6-b3a5510eff2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f005ad6-c30c-4279-8bcf-57ae9209ba04', 'volume_name': 'volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa50bf9e-7e5b-4723-a2a9-a106e3deeb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa50bf9e-7e5b-4723-a2a9-a106e3deeb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943fb220-0ccd-41a4-b1e0-9ac5661f18b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:48 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Volume 9f005ad6-c30c-4279-8bcf-57ae9209ba04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04', 'volume_size': 1} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-503945638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f005ad6-c30c-4279-8bcf-57ae9209ba04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e9fd73208e4dfe9f1d5471708686ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:48Z,use_quota=True,user_id='35861a3da4f5431b9eb9e4e8a25f29d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)}" {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Creating volume 9f005ad6-c30c-4279-8bcf-57ae9209ba04 {{(pid=87242) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:48 devstack cinder-volume[87242]: INFO cinder.volume.drivers.remotefs [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] casted to osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 1073741824 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:48 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 1073741824 Sep 25 10:56:48 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:48 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 1073741824" returned: 0 in 0.506s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:48 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 Sep 25 10:56:48 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:48 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04" returned: 0 in 0.259s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'} {{(pid=87242) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943fb220-0ccd-41a4-b1e0-9ac5661f18b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04', 'volume_size': 1}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a3918c-c371-455d-9df2-f06482bba682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:48 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Volume volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 (9f005ad6-c30c-4279-8bcf-57ae9209ba04): created successfully Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a3918c-c371-455d-9df2-f06482bba682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:48 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Flow 'volume_create_manager' (81f8e88f-5ba1-4055-a749-ca32cc9df247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:48 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-165275d6-fd2c-45ce-8f20-bbd493886df8 tempest-SnapshotDependencyTests-589545609 None] Created volume successfully. Sep 25 10:56:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:50 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Creating offline snapshot 8eb10a8f-3d3c-441a-b203-9021374a41dd of volume 9f005ad6-c30c-4279-8bcf-57ae9209ba04 {{(pid=87242) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 10:56:50 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beac11a-79c3-4327-a331-9d553fed2c09]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:50 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 Sep 25 10:56:50 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:50 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04" returned: 0 in 0.434s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:50 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd 1G {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:50 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd 1G Sep 25 10:56:50 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:51 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd 1G" returned: 0 in 0.479s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:51 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd Sep 25 10:56:51 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:51 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 -F qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd" returned: 0 in 0.319s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:51 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd is being set with open permissions: ugo+rw Sep 25 10:56:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:51 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd Sep 25 10:56:51 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:51 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd" returned: 0 in 0.288s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:51 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:51 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.info Sep 25 10:56:51 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:52 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.info" returned: 0 in 0.275s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:52 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.info is being set with open permissions: ugo+rw Sep 25 10:56:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.info {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:52 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.info Sep 25 10:56:52 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:52 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.info" returned: 0 in 0.286s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:52 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:52 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-79a10fe8-9928-4d8a-8738-fcdbdc17aac9 tempest-SnapshotDependencyTests-589545609 None] Create snapshot completed successfully Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87242) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Flow 'volume_create_manager' (8c485c76-5100-45fc-b367-c7795e5b97af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1046da-d002-450a-bac5-5042eaf98c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1046da-d002-450a-bac5-5042eaf98c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T08:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7d3c1b-ae9c-4580-b1c1-1018679f10d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e9fd73208e4dfe9f1d5471708686ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T08:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8eb10a8f-3d3c-441a-b203-9021374a41dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T08:56:54Z,use_quota=True,user_id='35861a3da4f5431b9eb9e4e8a25f29d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce9ecaa-40ef-401f-9e94-b5da6ab4490b),volume_type_id=4ce9ecaa-40ef-401f-9e94-b5da6ab4490b)' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef6cfd1-d4b9-4b93-9e60-28064ea430d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef6cfd1-d4b9-4b93-9e60-28064ea430d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab499ba-03f1-4876-a494-7d319368e29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab499ba-03f1-4876-a494-7d319368e29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2c7d3c1b-ae9c-4580-b1c1-1018679f10d2', 'volume_name': 'volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2', 'volume_size': 1, 'snapshot_id': '8eb10a8f-3d3c-441a-b203-9021374a41dd'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6085d3-7c4e-4e67-9c0f-0a0238174147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6085d3-7c4e-4e67-9c0f-0a0238174147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a2a8ee-4ec6-42a7-866b-89f6b0e8124d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:56:54 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Volume 2c7d3c1b-ae9c-4580-b1c1-1018679f10d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2', 'volume_size': 1, 'snapshot_id': '8eb10a8f-3d3c-441a-b203-9021374a41dd'} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "cinder-quobyte-8eb10a8f-3d3c-441a-b203-9021374a41dd-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" by "_create_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-8eb10a8f-3d3c-441a-b203-9021374a41dd-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Creating volume 2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 from snapshot 8eb10a8f-3d3c-441a-b203-9021374a41dd {{(pid=87242) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Selected osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5 as target Quobyte volume. {{(pid=87242) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "cinder-quobyte-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" by "_copy_volume_from_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] snapshot: 8eb10a8f-3d3c-441a-b203-9021374a41dd, volume: 2c7d3c1b-ae9c-4580-b1c1-1018679f10d2, {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3f2c0a-9126-4b35-9f76-356a3a35aeeb]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:54 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd Sep 25 10:56:54 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:54 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd" returned: 0 in 0.420s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2486a75d-33d3-4588-a605-eb6861c84bc3]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:56:54 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:55 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 Sep 25 10:56:55 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:56:55 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 25 10:56:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04" returned: 0 in 0.422s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:56:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] will copy from snapshot at /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 10:56:55 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Creating direct copy from snapshot {{(pid=87242) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 10:56:55 devstack cinder-volume[87242]: DEBUG cinder.utils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Path /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 not found in is_blk_device check {{(pid=87242) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 10:56:55 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:56:55 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 Sep 25 10:56:55 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:02 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" returned: 0 in 7.368s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:02 devstack cinder-volume[87242]: DEBUG cinder.image.image_utils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Image conversion details: src /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04, size 1024.00 MB, duration 7.37 sec, destination /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 {{(pid=87242) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 10:57:02 devstack cinder-volume[87242]: INFO cinder.image.image_utils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Converted 1024.00 MB image at 138.95 MB/s Sep 25 10:57:02 devstack cinder-volume[87242]: WARNING cinder.volume.drivers.remotefs [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 is being set with open permissions: ugo+rw Sep 25 10:57:02 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:02 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 Sep 25 10:57:02 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:03 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" returned: 0 in 0.317s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" released by "_copy_volume_from_snapshot" :: held 8.637s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-8eb10a8f-3d3c-441a-b203-9021374a41dd-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" released by "_create_volume_from_snapshot" :: held 8.718s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.740s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a2a8ee-4ec6-42a7-866b-89f6b0e8124d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2', 'volume_size': 1, 'snapshot_id': '8eb10a8f-3d3c-441a-b203-9021374a41dd'}' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b41b945-7a33-4339-bc1d-29db408b7551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 10:57:03 devstack cinder-volume[87242]: INFO cinder.volume.flows.manager.create_volume [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Volume volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 (2c7d3c1b-ae9c-4580-b1c1-1018679f10d2): created successfully Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b41b945-7a33-4339-bc1d-29db408b7551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87242) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Flow 'volume_create_manager' (8c485c76-5100-45fc-b367-c7795e5b97af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87242) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 10:57:03 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-3be95ef3-2761-42c9-8118-382916f68723 tempest-SnapshotDependencyTests-589545609 None] Created volume successfully. Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:03 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:57:03 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:03 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.329s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG oslo_service.periodic_task [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] Running periodic task VolumeManager._thread_info {{(pid=87242) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread count: 28 {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 10:57:03 devstack cinder-volume[87242]: DEBUG cinder.volume.manager [None req-d1eb6ddb-1ea1-4cf7-80f7-acb03401928b None None] thread info: [<_MainThread(MainThread, started 129952074264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87242) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "cinder-8eb10a8f-3d3c-441a-b203-9021374a41dd-delete_snapshot" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-8eb10a8f-3d3c-441a-b203-9021374a41dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "cinder-quobyte-9f005ad6-c30c-4279-8bcf-57ae9209ba04" by "delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-9f005ad6-c30c-4279-8bcf-57ae9209ba04" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "cinder-quobyte-8eb10a8f-3d3c-441a-b203-9021374a41dd" by "_delete_snapshot" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-8eb10a8f-3d3c-441a-b203-9021374a41dd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Deleting offline snapshot 8eb10a8f-3d3c-441a-b203-9021374a41dd of volume 9f005ad6-c30c-4279-8bcf-57ae9209ba04 {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] snapshot_file for this snap is: volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd {{(pid=87242) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbcac2d-afc6-4b8e-a0e3-acec55819d9d]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:04 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd Sep 25 10:57:04 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:04 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd" returned: 0 in 0.464s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.remotefs [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87242) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6830051-66a9-460c-b85d-b2c3d96594a2]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:04 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:04 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 Sep 25 10:57:04 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:05 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04" returned: 0 in 0.697s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:05 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd Sep 25 10:57:05 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:05 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd" returned: 0 in 0.425s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:05 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:05 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd Sep 25 10:57:05 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:06 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:06 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04.8eb10a8f-3d3c-441a-b203-9021374a41dd" returned: 0 in 0.298s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-8eb10a8f-3d3c-441a-b203-9021374a41dd" released by "_delete_snapshot" :: held 2.005s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-9f005ad6-c30c-4279-8bcf-57ae9209ba04" released by "delete_snapshot" :: held 2.035s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:06 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Created reservations ['be07a310-7f0a-4f41-810b-abf25ff9e480', 'f700fa29-d94a-4f3f-9382-9a25190417be', '55f4cf84-7bd4-4a75-91fd-a6fe7aeeb335', 'c79510af-e6bd-49a5-b868-45cca8b6c6b8'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:06 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Delete snapshot completed successfully. Sep 25 10:57:06 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-626dbd5c-e88f-4d69-b2f6-ec4b799aef91 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-8eb10a8f-3d3c-441a-b203-9021374a41dd-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "cinder-9f005ad6-c30c-4279-8bcf-57ae9209ba04-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-9f005ad6-c30c-4279-8bcf-57ae9209ba04-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "cinder-quobyte-9f005ad6-c30c-4279-8bcf-57ae9209ba04" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:07 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-9f005ad6-c30c-4279-8bcf-57ae9209ba04" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:07 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[34deca43-d00e-4f8d-9e49-9ea09d0d476b]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:07 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:07 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 Sep 25 10:57:07 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:08 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04" returned: 0 in 0.439s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:08 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04 Sep 25 10:57:08 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:08 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-9f005ad6-c30c-4279-8bcf-57ae9209ba04" returned: 0 in 0.306s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-9f005ad6-c30c-4279-8bcf-57ae9209ba04" released by "delete_volume" :: held 0.832s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Created reservations ['9fdcd223-3c87-464b-a690-4e74f5631d80', 'ab21562c-e617-4568-9d46-3c90a5590723', '880968af-474c-4c14-8004-d7fc6a51df9c', '6a4e4331-dc1f-4ff8-86f5-2c42dee16bac'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:08 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:57:08 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "cinder-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2-delete_volume" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "cinder-quobyte-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" by "delete_volume" {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" acquired by "delete_volume" :: waited 0.022s {{(pid=87242) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b802cbe2-dd31-4884-bb35-b370ad8158c0]: (4, 'qcow2') {{(pid=89017) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:08 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.327s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:57:08 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Deleted volume successfully. Sep 25 10:57:08 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-047f3f0f-bf8d-49f8-b2df-17466bb25481 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-9f005ad6-c30c-4279-8bcf-57ae9209ba04-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:09 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 Sep 25 10:57:09 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:09 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" returned: 0 in 0.441s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:09 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2 Sep 25 10:57:09 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:09 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38/volume-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" returned: 0 in 0.271s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-quobyte-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2" released by "delete_volume" :: held 0.776s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG cinder.quota [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Created reservations ['f2ca0465-43c9-46da-a94e-a0f4de5ef9fb', '926a12e8-1d5f-4912-9f32-2e8c6d939a5f', 'dd055fde-b9a3-4f38-b794-6d71d44d88e3', 'ff5a409a-b9d7-4cfc-bc26-7e396b780021'] {{(pid=87242) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5': None} {{(pid=87242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG cinder.volume.drivers.quobyte [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3688c65c-5c82-4b88-9dad-bc4b526dd5d5'] {{(pid=87242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.lockutils [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 10:57:09 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 10:57:09 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38 Sep 25 10:57:09 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 10:57:10 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 25 10:57:10 devstack cinder-volume[87242]: DEBUG oslo_concurrency.processutils [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/650ee8c5e7f17a20169b53cdd4b84b38" returned: 0 in 0.292s {{(pid=87242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 10:57:10 devstack cinder-volume[87242]: DEBUG cinder.manager [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Notifying Schedulers of capabilities ... {{(pid=87242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 10:57:10 devstack cinder-volume[87242]: INFO cinder.volume.manager [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Deleted volume successfully. Sep 25 10:57:10 devstack cinder-volume[87242]: DEBUG cinder.coordination [None req-583bd590-84c8-40fd-863c-5fdf3aed4c73 tempest-SnapshotDependencyTests-589545609 None] Lock "cinder-2c7d3c1b-ae9c-4580-b1c1-1018679f10d2-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87242) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 10:57:19 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:UPDATE=31,cinder:SELECT=24,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 10:57:20 devstack cinder-volume[87242]: DEBUG dbcounter [-] [87242] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=87242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}